-- Logs begin at Tue 2022-06-07 12:25:30 UTC, end at Tue 2022-06-07 13:34:46 UTC. -- Jun 07 12:56:52.533163 dv-cinder-844962-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 07 12:56:52.541904 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 12:56:52 2022] *** Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: nodename: dv-cinder-844962-1-iscsi Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: machine: x86_64 Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: clock source: unix Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: pcre jit disabled Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: detected number of CPU cores: 4 Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: current working directory: / Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: detected binary path: /usr/bin/uwsgi-core Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: your processes number limit is 47680 Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: your memory page size is 4096 bytes Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: detected max file descriptor number: 2048 Jun 07 12:56:52.543988 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: lock engine: pthread robust mutexes Jun 07 12:56:52.544682 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: thunder lock: enabled Jun 07 12:56:52.544682 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 07 12:56:52.544682 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 12:56:52.589044 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: Python main interpreter initialized at 0x5561bb1ca9c0 Jun 07 12:56:52.589044 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: python threads support enabled Jun 07 12:56:52.589044 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: your server socket listen backlog is limited to 100 connections Jun 07 12:56:52.589044 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: your mercy for graceful operations on workers is 90 seconds Jun 07 12:56:52.589413 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 12:56:52.589494 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: *** Operational MODE: preforking *** Jun 07 12:56:52.589794 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: *** uWSGI is running in multiple interpreter mode *** Jun 07 12:56:52.589794 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: spawned uWSGI master process (pid: 80505) Jun 07 12:56:52.590003 dv-cinder-844962-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 07 12:56:52.591092 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: spawned uWSGI worker 1 (pid: 80514, cores: 1) Jun 07 12:56:52.591092 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: spawned uWSGI worker 2 (pid: 80515, cores: 1) Jun 07 12:56:52.591092 dv-cinder-844962-1-iscsi devstack@keystone.service[80505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 12:56:58.220873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 12:56:58.220873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: from cryptography.utils import int_from_bytes Jun 07 12:56:58.221742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 12:56:58.221742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: from cryptography.utils import int_from_bytes Jun 07 12:56:58.221847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 12:56:58.221847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: from cryptography.utils import int_from_bytes Jun 07 12:56:58.221847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 12:56:58.221847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: from cryptography.utils import int_from_bytes Jun 07 12:56:58.270278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 12:56:58.270485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 12:56:58.270564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 12:56:58.270636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 12:56:58.270696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] command line args: [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 12:56:58.270759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] command line args: [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 12:56:58.270906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 12:56:58.271045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 12:56:58.271132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ================================================================================ {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 12:56:58.271212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ================================================================================ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 12:56:58.271289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] admin_token = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] admin_token = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] config_dir = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] config_dir = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] config_source = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.271996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] debug = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.272497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] config_source = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.272583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] debug = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.272641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.274973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_config_append = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_config_append = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_dir = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_dir = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_file = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.275992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.276958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.277843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] publish_errors = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] publish_errors = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.278973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279374 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] standard_threads = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] standard_threads = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.279900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] use_journal = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] use_json = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] use_journal = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] use_stderr = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] use_json = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] use_syslog = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.280929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] use_stderr = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.281105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] use_syslog = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.281242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.281323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 12:56:58.281400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.281572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.281696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.281787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.281861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.282940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.283996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.284918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.285894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.286927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.287984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.288995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.289941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.290982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.291966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.292991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.293909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.294882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.295991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.296982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.297238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.297331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.297475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.297552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.297764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.297902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.298935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.299972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.300951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.301871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.302884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.303898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.304930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.305974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.external = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.306996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.external = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.password = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.307928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] auth.token = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.password = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.token = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.308935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.309889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.310905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.311920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.312917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.313951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.314942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.315998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.316990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.317937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.318797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.319252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.319383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.319507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.319630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.319753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.319877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.320896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.321929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.322933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.323948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.324900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.325896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.326948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.327942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.328916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.329147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.329256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.329436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.329632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.329780 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.329918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.330911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.331930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.332958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.333981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.334927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.335952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336374 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.336887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.337899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.338877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.339897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.340942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] role.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] role.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.341992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] role.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] role.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.342981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.343923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.344910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.345956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.346940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.347975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.348905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.349888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.350836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.351940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.connection = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.352924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.353976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.354910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.355991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.356146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.356223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.356294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.356364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 12:56:58.356456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.356698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.357054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.357305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.357545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 12:56:58.357714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 12:56:58.385664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.385844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.386012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.386096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.386159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.386281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.394607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.394753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.423168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.423377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.423697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.423833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.476522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.477000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.524746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.524967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.526935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.527163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591588 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.591840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.592014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.592139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.592291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.592405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.614965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.615918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.616054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.616135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.616198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.616270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.616396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.627925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.628376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.640543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.640753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.640923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.641961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.642039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.642206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.642396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 12:56:58.659626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.659808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 12:56:58.659974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.660141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.660290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 12:56:58.660424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 12:56:58.660504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.660626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.660703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 12:56:58.660858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.661004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.661130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.661276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.661356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.661418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.661672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.672107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.672371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.672495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.672632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.672793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.672893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.673044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.673360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.681302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.681595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.684571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.684845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.684969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.685193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.685322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.685473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.685565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.685672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.685752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.685926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.686959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.687084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.687164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.687281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.687561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.713859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.714228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.715454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.715729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.715852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.716095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.721271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.721540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.721664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.721803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.721902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.722152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.729102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.729331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.729453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.729669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.733786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.734064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.734265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.734391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.734547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.734631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.734799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.734925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.735997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.736373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.754361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.754608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.755252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.755523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.759244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.760089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.763003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.763300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.763952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.764239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.768461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.769337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.772058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.773308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.776053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.776348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.776619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.776891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.777044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.777236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.777451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.777538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.777602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.777729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.778002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.778272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.796401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.796666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.796934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.797217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.797551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.797882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.798126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.798405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.805133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.806265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.808318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.808594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.809496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.809769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.811675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.811952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.812225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.812496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.812771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.813038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.813340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.813634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.813919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.814192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.826120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.826399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.826673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.826943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.827217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.827487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.827626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.827707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.827929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.828230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.828487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.828744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.829197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.829476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.845603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.847364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.857113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.857238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.857367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.857720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.857996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.857996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.863488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.865111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.865570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.867188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.868429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.868711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.868986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.869278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.870526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.870807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.871080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.871349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.878501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.878795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.879073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.880869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.881199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.881468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.887188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.887466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.887740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.888010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.888279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.888537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.888814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.889109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.889373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.889606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.889705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 12:56:58.889905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.890928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.891195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.891606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.891985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.892267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.892541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.892801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.893104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.893366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 12:56:58.928676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561bb1ca9c0 pid: 80514 (default app) Jun 07 12:56:58.931354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561bb1ca9c0 pid: 80515 (default app) Jun 07 12:56:58.932194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d262e9-f304-466d-8a18-70dd013dbe2c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:56:58.932482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d262e9-f304-466d-8a18-70dd013dbe2c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:56:58.932758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d262e9-f304-466d-8a18-70dd013dbe2c None None] PATH_INFO: `/v3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:56:58.937003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Jun 7 12:56:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:06.985209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:06.985930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:06.985930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:06.990387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:06.997003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:06.997475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:06.997629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:07.072112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: INFO dbcounter [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] Registered counter for database keystone Jun 07 12:57:07.096809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG oslo_db.sqlalchemy.engines [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 12:57:07.108754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writer thread running {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 12:57:07.402336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG passlib.handlers.bcrypt [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80514) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 12:57:07.402757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG passlib.handlers.bcrypt [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80514) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 12:57:07.464782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:07.467473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:07.611961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 617 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 07 12:57:07.748330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:07.825408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: INFO dbcounter [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] Registered counter for database keystone Jun 07 12:57:07.846909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG oslo_db.sqlalchemy.engines [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 12:57:07.858792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writer thread running {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 12:57:08.089338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d134-9544-4835-a29f-8d5474ff77c0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:08.097218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:08.097901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:08.098185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:08.098456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:08.108106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:08.159857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 12:57:08.160201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e5e54-0f32-4231-8081-1160021ac8fd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:08.170928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jun 7 12:57:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 12:57:08.180023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:08.194803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b55b-1d9d-4f55-841b-2805b89e1b7d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:08.199777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:08.200912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:08.201227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:08.201513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] PATH_INFO: `/v3/projects/ebd193fab79b438b93f957ec4ee6cab4` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:08.203053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] RBAC: Authorizing `identity:get_project(project_id=ebd193fab79b438b93f957ec4ee6cab4)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:08.253442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 12:57:08.253790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cad7aa-1fe1-49cf-a9be-ca117dffac93 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:08.259749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Jun 7 12:57:08 2022] GET /identity/v3/projects/ebd193fab79b438b93f957ec4ee6cab4 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:10.469261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010c69-5099-45cc-b74e-c9ffda88aaf3 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:10.470177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010c69-5099-45cc-b74e-c9ffda88aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:10.470177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010c69-5099-45cc-b74e-c9ffda88aaf3 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:10.474404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:10.481312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:10.481757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:10.482003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:10.509375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:10.510907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:10.520285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 07 12:57:10.543810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6010c69-5099-45cc-b74e-c9ffda88aaf3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:10.559612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6010c69-5099-45cc-b74e-c9ffda88aaf3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:10.565580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61985b-007c-4886-a78a-bd13c24c3041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:10.566225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61985b-007c-4886-a78a-bd13c24c3041 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:10.566510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61985b-007c-4886-a78a-bd13c24c3041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:10.566790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61985b-007c-4886-a78a-bd13c24c3041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:10.575803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61985b-007c-4886-a78a-bd13c24c3041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:10.577633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61985b-007c-4886-a78a-bd13c24c3041 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:10.586908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jun 7 12:57:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 12:57:10.593432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:10.606312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94b20-6fce-4f1e-af9e-baff8b6ac075 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:10.612220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cedcd-633b-4cf2-aea9-1b12663764ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:10.613135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cedcd-633b-4cf2-aea9-1b12663764ec admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:10.613421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cedcd-633b-4cf2-aea9-1b12663764ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:10.613696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cedcd-633b-4cf2-aea9-1b12663764ec admin admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:10.615156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cedcd-633b-4cf2-aea9-1b12663764ec admin admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:10.617000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cedcd-633b-4cf2-aea9-1b12663764ec admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:10.618640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Jun 7 12:57:10 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:12.920193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fce4d-8c5a-44ed-9808-ea72195b0fce None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:12.920718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fce4d-8c5a-44ed-9808-ea72195b0fce None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:12.920718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fce4d-8c5a-44ed-9808-ea72195b0fce None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:12.920950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7c0b-8320-4fcd-b51f-ec4afaf5b30a None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:12.921770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7c0b-8320-4fcd-b51f-ec4afaf5b30a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:12.922024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7c0b-8320-4fcd-b51f-ec4afaf5b30a None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:12.922145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:12.923702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:12.927809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:12.928102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:12.928379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:12.928693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:12.929086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:12.929451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:12.954341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:12.955637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:12.976048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG passlib.handlers.bcrypt [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80515) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 12:57:12.976460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG passlib.handlers.bcrypt [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80515) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 12:57:13.022725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:13.024350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:13.042130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:13.064070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.088889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.132408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:13.155630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.192543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0033d-3843-4bea-a845-e56954f8a8ef None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.228452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.229137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.229426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.229700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.261283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2383d-91cb-465a-937a-8bdf8f5cab75 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.263569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.301068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.302157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.302441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.302657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.302760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.304157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.315875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:13.326978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:13.327136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:13.328169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:13.329693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:13.334742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.406679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:13.412352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.435266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b007da3-ce96-42d7-9190-1072d55cc1cc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.472125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.472702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.472981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.473285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.474058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:13.474364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.475819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.487741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:13.493314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.513368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ccec7-1703-48e7-828d-544741b6f7c1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.522101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.536473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.548323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.549162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.549442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.549713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.560346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.561857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:57:13.582432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:13.583361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:13.584323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:57:13.584323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:57:13.584323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:57:13.584323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:13.584323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:13.589493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.597383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab353-7412-47fa-9043-d7cab78af832 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.630859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.631752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.632030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.632311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.633907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.635368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.637043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:13.642468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.692672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b3c4-20e7-4264-aa3c-254fe8eeb46d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.728995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.729630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.729914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.730190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.730924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:13.731233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.732631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.736829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.744569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f3207-c563-4b1f-909f-e2e2ba21bb02 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.750076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:13.780625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74a270-ba96-4a74-956f-6089d3c691d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.781502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a270-ba96-4a74-956f-6089d3c691d4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.781784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a270-ba96-4a74-956f-6089d3c691d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.782062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a270-ba96-4a74-956f-6089d3c691d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.783960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74a270-ba96-4a74-956f-6089d3c691d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.785515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74a270-ba96-4a74-956f-6089d3c691d4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.787276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:13.793410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:13.832554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:13.906395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e727b-5441-4eee-b4ec-4d1673454c10 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:13.945667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:13.946342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:13.946625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:13.946900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:13.947746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.domain.id=default, user.id=f8993b31c1f849d2899564c3495501c1) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:13.948057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:13.949572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917366-a75c-4a3e-a146-c9fd7a607f97 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:13.957122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jun 7 12:57:13 2022] GET /identity/v3/role_assignments?user.id=f8993b31c1f849d2899564c3495501c1&scope.domain.id=default&role.id=62f04dcd631e4206baea551a55948cbb => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:16.426830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627d89-20b1-49c4-b4b2-a687e8b91c80 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:16.427359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627d89-20b1-49c4-b4b2-a687e8b91c80 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:16.427359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627d89-20b1-49c4-b4b2-a687e8b91c80 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:16.429190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:16.434657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b1b6-2fda-4c7f-a941-66767bb97fbd None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:16.435099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b1b6-2fda-4c7f-a941-66767bb97fbd None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:16.435272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b1b6-2fda-4c7f-a941-66767bb97fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:16.462048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f039b1b6-2fda-4c7f-a941-66767bb97fbd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:16.463274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f039b1b6-2fda-4c7f-a941-66767bb97fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:16.558617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:16.584352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8a2d9-293d-4576-815d-d93c34982845 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:16.584966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8a2d9-293d-4576-815d-d93c34982845 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:16.585488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8a2d9-293d-4576-815d-d93c34982845 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:16.587051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:16.592811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8a2d9-293d-4576-815d-d93c34982845 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:16.593039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:16.593328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:16.593610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:16.626213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:16.627553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:16.655339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:16.730390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:16.768093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:16.805645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8a2d9-293d-4576-815d-d93c34982845 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:16.841605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550b1fe-bedf-4c06-a6ef-bd2130c6dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:16.842530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b1fe-bedf-4c06-a6ef-bd2130c6dad0 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:16.842970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b1fe-bedf-4c06-a6ef-bd2130c6dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:16.843561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b1fe-bedf-4c06-a6ef-bd2130c6dad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:16.844609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550b1fe-bedf-4c06-a6ef-bd2130c6dad0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:16.846331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550b1fe-bedf-4c06-a6ef-bd2130c6dad0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:16.983392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121d2b6-9d51-4335-9f80-c821c102cf28 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:16.992165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 13/26] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jun 7 12:57:16 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:57:16.993978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c3cb-9c83-4292-a02f-f2f41587751d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:16.994412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c3cb-9c83-4292-a02f-f2f41587751d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:16.994876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c3cb-9c83-4292-a02f-f2f41587751d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:16.997000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:17.008509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.009043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.009492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.034606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:17.036380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:17.045937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:17.046653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.046944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.047247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.061453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:17.102002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:17.113485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:17.119292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:17.120170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:17.120926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:17.124080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 14/29] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:17.130708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:17.145950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:17.202506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:17.248937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060a17f-fa48-496b-b4b3-dd117e95c193 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:17.285873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:17.286926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.287534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.288021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.289001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:17.289556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:17.291442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d7aad-7576-4ad0-9894-1e4485d4042a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:17.301585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 16/30] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:17.303329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30f450-5fbf-4edd-9c4b-e6522ab06022 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.303820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30f450-5fbf-4edd-9c4b-e6522ab06022 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.304300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30f450-5fbf-4edd-9c4b-e6522ab06022 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.305940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 17/31] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:17.309551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30f450-5fbf-4edd-9c4b-e6522ab06022 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:17.328152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:17.398463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106097-e93e-4191-b797-7a3b81bec141 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:17.435949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30f450-5fbf-4edd-9c4b-e6522ab06022 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:17.439702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:17.440969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.441511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.441988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.442949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:17.444794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:17.475154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f25543-66e2-4917-83ec-10c573123798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:17.476429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f25543-66e2-4917-83ec-10c573123798 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.476898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f25543-66e2-4917-83ec-10c573123798 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.477395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f25543-66e2-4917-83ec-10c573123798 None admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.478805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f25543-66e2-4917-83ec-10c573123798 None admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:17.480583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f25543-66e2-4917-83ec-10c573123798 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:17.482706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 18/32] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:17 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:17.484143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.484609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.485109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:17.505130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:17.591201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:17.592852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:17.597254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 15/34] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jun 7 12:57:17 2022] POST /identity/v3/roles => generated 225 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:57:17.611492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:17.646347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:17.712772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3422e-a2d3-41b5-93d5-182a16df7391 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:17.755357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:17.756114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:17.756398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:17.756676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:17.758061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:17.760408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:17.762371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 20/35] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:17.769081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:17.885421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:17.909814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:17.953714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dd9d9-9d4c-4602-b6ea-70f7ab3f830e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:17.968965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23438a2-e284-4e7d-8bbe-28b21ab3441d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:18.022092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.023691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.025177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.026335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] PATH_INFO: `/v3/domains/default/users/f8993b31c1f849d2899564c3495501c1/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.029366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f8993b31c1f849d2899564c3495501c1, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.032013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.037750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.038862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.039338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.039816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.062279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.067096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.077802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 21/36] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Jun 7 12:57:17 2022] PUT /identity/v3/domains/default/users/f8993b31c1f849d2899564c3495501c1/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-799c8995-4e79-4157-8cde-eabb64f59b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:57:18.091704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:18.092600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:18.093419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:57:18.093419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:57:18.093419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:57:18.093419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:18.096336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 16/37] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:18.103818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:18.166579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036430b-493e-4aca-a9b3-b30831727dee None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.167095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036430b-493e-4aca-a9b3-b30831727dee None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.167265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036430b-493e-4aca-a9b3-b30831727dee None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.168936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 17/38] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:18.176598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d94c4-c42b-4aee-ba4d-8d8ddb877dec None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.177858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d94c4-c42b-4aee-ba4d-8d8ddb877dec None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.178144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d94c4-c42b-4aee-ba4d-8d8ddb877dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.200848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-630d94c4-c42b-4aee-ba4d-8d8ddb877dec None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:18.202933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-630d94c4-c42b-4aee-ba4d-8d8ddb877dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:18.274820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62bca9-a660-44ab-a7fa-00cf702ec470 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:18.304437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:18.306350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dafdf1-bc92-46ef-9ac8-afa9524bb49e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.306938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dafdf1-bc92-46ef-9ac8-afa9524bb49e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.307909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dafdf1-bc92-46ef-9ac8-afa9524bb49e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.311168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 19/40] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:18.319147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.319760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.320520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.347595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.347789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:18.348299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.348712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.348883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.349219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:18.349814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:18.350147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.351717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.373376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:18.382415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 22/41] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:18.383338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:18.416495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:18.428450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:18.433032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:18.499039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9bce1-3e42-4613-b670-2e0d947f6e2c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:18.534915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.535937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.536235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.536518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.537327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.538329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc4a9-542a-47c8-986c-ce0d57d321bf None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:18.538750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.557475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 23/43] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jun 7 12:57:18 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:18.558475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:18.583707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.584521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.584816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.585150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.586007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.588219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.633680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:57:18 2022] POST /identity/v3/projects => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:18.656039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:18.711779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4b9b1-7b0f-415e-8143-2298065322de None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:18.761106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773e934-901a-427b-9f55-14cc93bbcd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.761965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e934-901a-427b-9f55-14cc93bbcd4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.762257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e934-901a-427b-9f55-14cc93bbcd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.762540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e934-901a-427b-9f55-14cc93bbcd4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.763898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773e934-901a-427b-9f55-14cc93bbcd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.765471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773e934-901a-427b-9f55-14cc93bbcd4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.767945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:18.774314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:18.830928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:18.896601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d758-ff90-4d13-b074-5ef1c36ad996 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:18.932542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6350e-1f24-4888-bb4d-d3a6f94a8d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:18.933245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6350e-1f24-4888-bb4d-d3a6f94a8d75 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:18.933529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6350e-1f24-4888-bb4d-d3a6f94a8d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:18.933803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6350e-1f24-4888-bb4d-d3a6f94a8d75 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:18.934533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6350e-1f24-4888-bb4d-d3a6f94a8d75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:18.936135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6350e-1f24-4888-bb4d-d3a6f94a8d75 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:18.962447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:57:18 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:20.436864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ddc8-d6b8-4206-8da4-c363ae8110e2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:20.437433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ddc8-d6b8-4206-8da4-c363ae8110e2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:20.437433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ddc8-d6b8-4206-8da4-c363ae8110e2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:20.439056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:20.444312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048728f-068e-4e76-839f-c41e46324679 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:20.444723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048728f-068e-4e76-839f-c41e46324679 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:20.444949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048728f-068e-4e76-839f-c41e46324679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:20.462766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0048728f-068e-4e76-839f-c41e46324679 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:20.463944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0048728f-068e-4e76-839f-c41e46324679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:20.533352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:20.556311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ddc8-d6b8-4206-8da4-c363ae8110e2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:20.663603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ddc8-d6b8-4206-8da4-c363ae8110e2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:20.690991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:20.700209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:20.701037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:20.701339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:20.701616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:20.712772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:20.720695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:20.721651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:20.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:20.727765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048728f-068e-4e76-839f-c41e46324679 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:20.752856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:20.831223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048728f-068e-4e76-839f-c41e46324679 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:20.868019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:20.868719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:20.869001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:20.869308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:20.870101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:20.870407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:20.871868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:20.885857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 24/50] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:20.891757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:20.996040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff6f8a-9954-4c62-93bf-f79334822b33 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:21.031380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:21.032339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.032690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.032974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.034256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:21.035727 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:21.037400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 27/51] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:20 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:21.043189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:21.130354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:21.146789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5c071-41d2-41b2-8912-b5d70c1b0764 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:21.182357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630910-8fcb-4152-9dba-e9c2dd798ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:21.183167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630910-8fcb-4152-9dba-e9c2dd798ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.183454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630910-8fcb-4152-9dba-e9c2dd798ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.183750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630910-8fcb-4152-9dba-e9c2dd798ca5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.184938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630910-8fcb-4152-9dba-e9c2dd798ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:21.186419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630910-8fcb-4152-9dba-e9c2dd798ca5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:21.188043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 25/52] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:21.194031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:21.200078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7288f-28f2-4ae9-aefd-489676e92cb2 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.200368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7288f-28f2-4ae9-aefd-489676e92cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.200656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7288f-28f2-4ae9-aefd-489676e92cb2 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.202040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 26/53] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:21.207229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.207525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.207807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.224726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:21.225958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:21.257664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:21.292685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 27/54] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:21.306675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e750f-8e85-4380-8dda-2ea94233eaac None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:21.316082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:21.341679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:21.342355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.342642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.342943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.343864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.domain.id=default, user.id=f8993b31c1f849d2899564c3495501c1) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:21.344176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:21.345763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:21.354162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jun 7 12:57:21 2022] GET /identity/v3/role_assignments?user.id=f8993b31c1f849d2899564c3495501c1&scope.domain.id=default&role.id=62f04dcd631e4206baea551a55948cbb => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:21.409938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:21.428156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de8e36-12a2-45df-a36c-91024acfada3 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:21.466181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369ce21-ef84-4438-9bb2-d27a3cae126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:21.466989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369ce21-ef84-4438-9bb2-d27a3cae126a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.467283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369ce21-ef84-4438-9bb2-d27a3cae126a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.467553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369ce21-ef84-4438-9bb2-d27a3cae126a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.468822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369ce21-ef84-4438-9bb2-d27a3cae126a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:21.470505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369ce21-ef84-4438-9bb2-d27a3cae126a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:21.472182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:21.478082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:21.588530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6270c9d-2ec3-4c97-8f4e-97a66cd8901a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:21.610160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:21.623792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfee0da-0220-4876-b3c9-dface8ba9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:21.624483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee0da-0220-4876-b3c9-dface8ba9093 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:21.624763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee0da-0220-4876-b3c9-dface8ba9093 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:21.625051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee0da-0220-4876-b3c9-dface8ba9093 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:21.625796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee0da-0220-4876-b3c9-dface8ba9093 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:21.627421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee0da-0220-4876-b3c9-dface8ba9093 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:21.661613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 29/57] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jun 7 12:57:21 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:23.906023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf044-6706-4acc-886d-690b6d73ba61 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:23.906837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf044-6706-4acc-886d-690b6d73ba61 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:23.906837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf044-6706-4acc-886d-690b6d73ba61 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:23.909087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:23.917815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:23.918238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:23.918426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:23.944304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:23.945547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:24.014235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:24.046013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf044-6706-4acc-886d-690b6d73ba61 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:24.156556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf044-6706-4acc-886d-690b6d73ba61 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:24.197075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda8b08-e8a8-47ba-a5ad-49c325f7a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:24.197915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8b08-e8a8-47ba-a5ad-49c325f7a55e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:24.198195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8b08-e8a8-47ba-a5ad-49c325f7a55e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:24.198467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8b08-e8a8-47ba-a5ad-49c325f7a55e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:24.199766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda8b08-e8a8-47ba-a5ad-49c325f7a55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:24.201283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda8b08-e8a8-47ba-a5ad-49c325f7a55e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:24.202928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:24.209489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:24.343126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eda65-c80b-4bba-be30-3fd47159cd06 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:24.345033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:24.381151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f120b0-0af0-4ca1-b0ab-f998ae318378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:24.381815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f120b0-0af0-4ca1-b0ab-f998ae318378 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:24.382099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f120b0-0af0-4ca1-b0ab-f998ae318378 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:24.382367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f120b0-0af0-4ca1-b0ab-f998ae318378 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:24.383087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f120b0-0af0-4ca1-b0ab-f998ae318378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:24.384547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f120b0-0af0-4ca1-b0ab-f998ae318378 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:24.414782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:24 2022] POST /identity/v3/users => generated 275 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:27.902782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371a20-3c00-4090-ad83-ca95990af225 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:27.903782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371a20-3c00-4090-ad83-ca95990af225 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:27.904264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371a20-3c00-4090-ad83-ca95990af225 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:27.905910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:27.911688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf165b0-25d7-4bd9-99f6-a08b8d9919f3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:27.912566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf165b0-25d7-4bd9-99f6-a08b8d9919f3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:27.913076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf165b0-25d7-4bd9-99f6-a08b8d9919f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:27.938342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9cf165b0-25d7-4bd9-99f6-a08b8d9919f3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:27.940197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9cf165b0-25d7-4bd9-99f6-a08b8d9919f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:27.956046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a16b-bee1-44f9-841a-1d3c6b17b955 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:27.957252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a16b-bee1-44f9-841a-1d3c6b17b955 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:27.958032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a16b-bee1-44f9-841a-1d3c6b17b955 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:27.959923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:27.967229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:27.967855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:27.968350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:27.993248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:27.994772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:28.010484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:28.045778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c359-a331-478e-a547-4fb863a2d912 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.046716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c359-a331-478e-a547-4fb863a2d912 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.047147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c359-a331-478e-a547-4fb863a2d912 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.049290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 33/65] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:28.054316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.054602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.054878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.076327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:28.078096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:28.080861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:28.082268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.173199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:28.174479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.192948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.206827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a8f75-6c2f-4eec-8734-3a055f5814f9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.244666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.245778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.246270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.246738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.258170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:28.266047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:28.266882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:28.267702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:28.270137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:28.271170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.280718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34516d9-595d-422d-a8cf-71ed712ad331 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.285646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.318576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.319754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.320035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.320463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.331903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:28.339614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:28.340608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:28.341555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:28.343518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:28.344331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.383334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93153f4-17b2-4ca8-a983-1cfd956d8736 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.419565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1577-87e6-4058-b746-09b4e8f826d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.420388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1577-87e6-4058-b746-09b4e8f826d4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.420670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1577-87e6-4058-b746-09b4e8f826d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.420947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1577-87e6-4058-b746-09b4e8f826d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.431029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.432079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c1577-87e6-4058-b746-09b4e8f826d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-bc4c1577-87e6-4058-b746-09b4e8f826d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:28.440406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:28.441318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:28.442070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:28.443805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087e433-cd6f-4878-8658-c60d74480550 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.443805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087e433-cd6f-4878-8658-c60d74480550 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.443805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087e433-cd6f-4878-8658-c60d74480550 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.444833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 36/71] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:28.449160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087e433-cd6f-4878-8658-c60d74480550 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.461427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b08984-9fad-4b0d-9dff-53b20cd2cfc5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.495053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.495738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.496024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.496311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.497100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:28.497412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:28.498829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6822f88-dd92-460f-a290-ea665d078feb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:28.507016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:28.508295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.508594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.508881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.518888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.525209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:28.526425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:28.556034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087e433-cd6f-4878-8658-c60d74480550 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.589208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.589885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.590170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.590444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.591193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:28.591528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:28.593036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc1536-d958-42ba-9028-a5a0d77fdc40 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:28.593669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 37/73] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:28.594397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.602227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:28.603370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7d76-cada-4e5f-8fd3-39230c95d9a7 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.603662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7d76-cada-4e5f-8fd3-39230c95d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.603936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7d76-cada-4e5f-8fd3-39230c95d9a7 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.607138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 38/75] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:28.607138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc7d76-cada-4e5f-8fd3-39230c95d9a7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.668363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.698943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d6d79-6955-45cf-8523-40f10ebd00e1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.715590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc7d76-cada-4e5f-8fd3-39230c95d9a7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.732206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.732890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.733220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.733483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.734236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:28.734546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:28.736001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:28.743841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:28.744608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.748983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.753354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304543d4-a39a-4b83-83a6-07111bd1c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.754589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304543d4-a39a-4b83-83a6-07111bd1c3ae None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.754879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304543d4-a39a-4b83-83a6-07111bd1c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.755160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304543d4-a39a-4b83-83a6-07111bd1c3ae None admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.756399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304543d4-a39a-4b83-83a6-07111bd1c3ae None admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:28.757897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304543d4-a39a-4b83-83a6-07111bd1c3ae None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:28.759550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:28.760767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.761148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.761384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.778188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:28.779395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:28.851795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ca86d-8fdd-4ba9-8da4-597c17d32131 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.853185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 40/78] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:28.855057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.885199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.890598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.891504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.891799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:28.892149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:28.909553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:28.911030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:28.912772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:28.913588 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:28.964834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cc83a-58b0-4be5-a460-c72334d68682 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:28.992563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:28.998697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:28.999509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:28.999791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.000066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.010256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:29.017926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:29.018790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:29.019525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:29.020101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b14be-7040-4e50-baea-1f8ebbc20078 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.020176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:29.020176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.054577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.055458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.055766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.056030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.057265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.058744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.060400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 40/81] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:28 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:29.061196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.119795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.129256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeacd58-75e2-4537-a1b4-1eb70f000d09 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.162105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ede7-0d2f-43d1-8b07-dc6db55a696d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.169356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.170033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.170313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.170589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.196486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.197326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.197609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.197882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.199074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.200533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.202243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:29.203011 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.232441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.243564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.245107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.303940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bf3a-b787-4479-a49a-0edb60951b52 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.328849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.337951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.338692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.339055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.339335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.343686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:29.344630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.408411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.409905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.440263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.450875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065eb77-22d9-465f-9b53-e0b679411ca9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.484219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.484835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.485143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.485425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.486270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:29.486582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.487972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.495888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 43/84] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:29.496674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.508371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 42/85] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:29.509252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.536629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.604835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27c17-e740-4a66-9bb1-4628152fa8c6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.611075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c9d5-89f5-474b-affe-6b23d57a030e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.640140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.640803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.641109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.641393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.645330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.646013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.646297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.646559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.647287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.649141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.663132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.670628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 43/86] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:29 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:29.671454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.721134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.722699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.781594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.803780 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf2e5-066c-4a4b-85ce-7d39a46fdf89 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.838938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 44/87] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:29.840517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:29.841459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:29.841748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:29.842037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:29.843555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:29.844249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.845082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:29.846962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:29.847779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:29.908570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:29.967261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588524-1f30-4fcb-8479-81631c72d196 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:29.974645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c5224-d356-4a90-a9c5-dbdf598b9aaa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.009416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.010317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.010600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.010871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.012486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.014137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.015944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.016560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.022923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.024103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.024579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.025074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.026491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.028089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.030409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:29 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.031219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.052654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:30.134377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e2ff-a8f8-4aae-877c-606dfdfa1635 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.159953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38b1d-d248-4faa-aaf4-f0aaf1051499 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.164326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:30.183016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.184447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.184911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.185609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.187605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.189728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.191708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.196719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.205327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.206025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.206313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.206595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.207646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=f8993b31c1f849d2899564c3495501c1) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:30.207969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.209498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.216074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/role_assignments?user.id=f8993b31c1f849d2899564c3495501c1&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.222134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.330898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe536ed-41f8-4fd4-9a4c-edb8563b4efe None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.387777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.388943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.389453 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.389935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.424269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:30.465121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0ed30-ab4b-427f-a89f-140da6d44a9e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.491920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:30.508879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.509775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.510171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.510455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.511140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.511323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=6addd6a8b31d431899bd0115468c2933) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:30.511629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.513120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.513545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.520161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 47/93] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/role_assignments?user.id=6addd6a8b31d431899bd0115468c2933&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=c5faf990280443b18b96e64a7fee2798 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.520791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.727657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 47/94] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:30.734228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.750603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d134-6efa-494f-95aa-1e778abc19ab None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.803159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.804837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.805278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.805613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.806521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] RBAC: Adding query filter params (role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=6addd6a8b31d431899bd0115468c2933) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:30.806843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.808438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.815650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/role_assignments?user.id=6addd6a8b31d431899bd0115468c2933&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=d0a91103ec054c63b098cc4abec5731f => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.900594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:30.919623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0129-364b-4984-b9bf-4c45de03c53f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:30.958053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c15b26-389f-491b-9d8d-72429b18317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:30.958957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c15b26-389f-491b-9d8d-72429b18317c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:30.959245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c15b26-389f-491b-9d8d-72429b18317c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:30.959527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c15b26-389f-491b-9d8d-72429b18317c None admin] PATH_INFO: `/v3/projects/272d94a8f40145ee8877ff08a929757f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:30.960751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c15b26-389f-491b-9d8d-72429b18317c None admin] RBAC: Authorizing `identity:get_project(project_id=272d94a8f40145ee8877ff08a929757f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:30.962306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c15b26-389f-491b-9d8d-72429b18317c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:30.964127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/projects/272d94a8f40145ee8877ff08a929757f => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:30.970309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:30.984086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:31.086429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d683-d503-413b-a0f1-5cea38d0f90a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:31.140635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:31.141372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:31.141657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:31.141940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:31.143320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=272d94a8f40145ee8877ff08a929757f, user.id=6addd6a8b31d431899bd0115468c2933) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:31.143642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:31.145198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b81e5-657b-4651-8dd7-e4eab03224f4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:31.152345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:30 2022] GET /identity/v3/role_assignments?user.id=6addd6a8b31d431899bd0115468c2933&scope.project.id=272d94a8f40145ee8877ff08a929757f&role.id=c5faf990280443b18b96e64a7fee2798 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:32.508533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dfdac-5b73-4cdd-8788-06b9e69813cd None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:32.509672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dfdac-5b73-4cdd-8788-06b9e69813cd None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:32.510163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dfdac-5b73-4cdd-8788-06b9e69813cd None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:32.511763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:32.517450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b542-a783-499d-b08c-e36b41efe69f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:32.518411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b542-a783-499d-b08c-e36b41efe69f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:32.518894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b542-a783-499d-b08c-e36b41efe69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:32.536739 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-29c9b542-a783-499d-b08c-e36b41efe69f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:32.538291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-29c9b542-a783-499d-b08c-e36b41efe69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:32.624467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 50/99] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:32.663909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dfdac-5b73-4cdd-8788-06b9e69813cd None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:32.788613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6360b-5e88-4c11-be75-cf2e721ca54a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:32.789258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6360b-5e88-4c11-be75-cf2e721ca54a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:32.789755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6360b-5e88-4c11-be75-cf2e721ca54a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:32.792085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dfdac-5b73-4cdd-8788-06b9e69813cd None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:32.793799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:32.804508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:32.805183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:32.805682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:32.825391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:32.837201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:32.838680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:32.853857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:32.857038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:32.857038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:32.857038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:32.859671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:32.861359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:32.863292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 50/101] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:32.869317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:32.919598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:33.019651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:33.029105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275f13-a88b-41f1-a2e1-ec2ec6c50b43 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:33.050980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:33.071578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:33.072616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:33.073938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:33.074424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:33.076107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:33.077976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:33.122534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 51/103] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:57:32 2022] POST /identity/v3/projects => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:33.222438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fff37-7ec0-487a-ac07-d26483a9826b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:33.274652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:33.275897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:33.276400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:33.276877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:33.279554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:33.298004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:33.306801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:33.307718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:33.308494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:33.311048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 53/104] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:33.316888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:33.429460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:33.459382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095868cd-d4aa-4024-9ab5-04e04e1a0ca2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:33.508604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:33.509421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:33.509609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:33.509890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:33.510658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:33.510972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:33.512366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:33.522134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:33.530199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:33.685394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70c4e-a727-4583-8b51-fc4d17bbae1a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:33.730244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6ebd-ed9e-432a-9ad5-c384f6888d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:33.731566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6ebd-ed9e-432a-9ad5-c384f6888d14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:33.732074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6ebd-ed9e-432a-9ad5-c384f6888d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:33.732611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6ebd-ed9e-432a-9ad5-c384f6888d14 None admin] PATH_INFO: `/v3/users/c066af0b1c18463292fb689bf24bdbef` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:33.754579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6ebd-ed9e-432a-9ad5-c384f6888d14 None admin] RBAC: Authorizing `identity:get_user(user_id=c066af0b1c18463292fb689bf24bdbef)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:33.756559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6ebd-ed9e-432a-9ad5-c384f6888d14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:33.758671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 54/106] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:33 2022] GET /identity/v3/users/c066af0b1c18463292fb689bf24bdbef => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:33.764683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:33.904121 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6b808-554d-4d1b-8364-6fd4329ce3e6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:33.944991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:33.945715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:33.946007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:33.946285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:33.957049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.034367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:34.035865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:34.113279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76aa7c-6153-4662-9c0d-50de2434ee92 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.113927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76aa7c-6153-4662-9c0d-50de2434ee92 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.114420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76aa7c-6153-4662-9c0d-50de2434ee92 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.116014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 55/107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:34.122350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080ee6-9888-4774-b3ac-5e40947ce5b6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.122927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080ee6-9888-4774-b3ac-5e40947ce5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.123399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080ee6-9888-4774-b3ac-5e40947ce5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.154842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9b080ee6-9888-4774-b3ac-5e40947ce5b6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:34.156397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9b080ee6-9888-4774-b3ac-5e40947ce5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:34.180193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 53/108] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:34.186186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:34.251525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.257409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.272490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 56/109] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:34.274495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601260-1562-4594-acaf-90d897811441 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.274957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601260-1562-4594-acaf-90d897811441 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.275441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601260-1562-4594-acaf-90d897811441 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.276834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 57/110] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:34.285075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ffea8-4a38-4d00-9f8d-5ba57225136d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.285075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ffea8-4a38-4d00-9f8d-5ba57225136d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.285075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ffea8-4a38-4d00-9f8d-5ba57225136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.319986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-578ffea8-4a38-4d00-9f8d-5ba57225136d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:34.323164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-578ffea8-4a38-4d00-9f8d-5ba57225136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:34.361640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51632e14-d9f7-4897-88f9-6f3d41ff77ef None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:34.433095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:34.433893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.434173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.434447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.435885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:34.437713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:34.439634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 54/111] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:34.440415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:34.452872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 58/112] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:34.454431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdeba-a774-4140-8209-0f6ad4c5397e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.454814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdeba-a774-4140-8209-0f6ad4c5397e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.455154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdeba-a774-4140-8209-0f6ad4c5397e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.456452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 59/113] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:34.460813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfdeba-a774-4140-8209-0f6ad4c5397e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:34.558732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24262dea-f2da-4e52-bb4d-24bfb4f0e0ed None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:34.568114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.583478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfdeba-a774-4140-8209-0f6ad4c5397e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:34.597881 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc64c3-14ac-48f2-b216-611ee8020fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:34.599089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc64c3-14ac-48f2-b216-611ee8020fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.599377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc64c3-14ac-48f2-b216-611ee8020fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.599652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc64c3-14ac-48f2-b216-611ee8020fc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.602616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.614171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc64c3-14ac-48f2-b216-611ee8020fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-61fc64c3-14ac-48f2-b216-611ee8020fc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:34.622353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:34.623490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:34.624394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 55/114] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:34.625331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97add3-d5f4-42ff-9691-86b3e56b3a10 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.625331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97add3-d5f4-42ff-9691-86b3e56b3a10 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.625460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97add3-d5f4-42ff-9691-86b3e56b3a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.630109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:34.630784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.631073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.632084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.632257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] RBAC: Adding query filter params (role.id=5a0a716f6c914a16ab4b765a8faa97b0, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=c066af0b1c18463292fb689bf24bdbef) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:34.632557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:34.634062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:34.640765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 60/115] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/role_assignments?user.id=c066af0b1c18463292fb689bf24bdbef&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=5a0a716f6c914a16ab4b765a8faa97b0 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:34.641600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:34.642815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1f97add3-d5f4-42ff-9691-86b3e56b3a10 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:34.644031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1f97add3-d5f4-42ff-9691-86b3e56b3a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:34.763896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 56/116] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:34.765411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45e0b-83f4-49d4-aadc-c95ce8fd101a None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.765688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45e0b-83f4-49d4-aadc-c95ce8fd101a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.765973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45e0b-83f4-49d4-aadc-c95ce8fd101a None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.767599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 57/117] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:34.773570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45e0b-83f4-49d4-aadc-c95ce8fd101a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:34.805543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16658fc-b0c2-4c6d-a927-4e0810ed6e73 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:34.851440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84c00-6ed6-4f69-9dda-4f3fbdafaa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:34.852372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84c00-6ed6-4f69-9dda-4f3fbdafaa85 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.852660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84c00-6ed6-4f69-9dda-4f3fbdafaa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.852946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84c00-6ed6-4f69-9dda-4f3fbdafaa85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.864484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df84c00-6ed6-4f69-9dda-4f3fbdafaa85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0df84c00-6ed6-4f69-9dda-4f3fbdafaa85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:34.872207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:34.873063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:34.873970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:34.874579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 61/118] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:34.875639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.875933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.876212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.893577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:34.894778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:34.899585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.903356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45e0b-83f4-49d4-aadc-c95ce8fd101a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:34.932820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:34.949216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:34.950695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:34.951476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:34.951948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:34.953195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:34.954174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:34.956058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:34.967913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 58/119] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:34.969140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:34.975182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 62/120] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:34.976103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.102942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97f5c-b489-40dc-a03a-71ea7126bae8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.105696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4b6bc-b74b-40fb-89ec-0f64f4614a97 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.146982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.148149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.148505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.148852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.149925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:35.150309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.151707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.151839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.152841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.153611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.154062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.161917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.162944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.169097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:35.178709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:35.181309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 59/122] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:35.182222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.201467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:35.210696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:35.305440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5d16-16f4-4634-a9ae-bd92608b87ac None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.307619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b5ed-2a9d-4c51-85cf-f1806a23673e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.340125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.340974 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.341287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.341660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.352574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:35.353493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.354622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.355093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.355662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.357140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.358964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:35.360465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:35.361435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:35.367506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.368222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 64/124] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.368222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.456425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:35.481237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5a68b-3f2e-41d7-96b9-61b993ee42ee None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.498634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:35.504926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34894f8-6b8c-434b-b93f-a451dc28594e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.531384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.532899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.533381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.533938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.535907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.538174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.540338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 61/125] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.544923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.547697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.548711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.549032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.549321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.550403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:35.550521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.551884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.560978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.561917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.677200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73481b-2652-4580-b980-edda40a54281 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.689706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa530a-4ce2-4462-99c6-a0dd64c04c33 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.724424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.725770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.726005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.726491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.726696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.726983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.727263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.727524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.728027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:35.728339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.729316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.729776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.731440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.739042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 66/127] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.739042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.745246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 62/128] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.749115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.765424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:35.772989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:35.857182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c46892-6f8e-4855-8b02-272433411a44 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.889242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e96e-5234-41e6-ad2f-53f08c687a6f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:35.893759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.894652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.894940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.895219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.896486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.898406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.900149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 67/129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.905166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:35.944496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:35.945845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:35.946335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:35.946800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:35.949191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:35.951619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:35.954390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 63/130] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:35.955531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.012020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:36.020829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b62675-e258-4deb-8594-f3bb8ac8f18c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.053761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:36.058376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:36.059600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.060025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.060442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/6addd6a8b31d431899bd0115468c2933/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.064144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f1a8bc8a814143aeb23e059c53bffb, user_id=6addd6a8b31d431899bd0115468c2933, role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:36.067008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:36.084600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 68/131] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:35 2022] PUT /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/6addd6a8b31d431899bd0115468c2933/roles/d0a91103ec054c63b098cc4abec5731f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:36.085365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fd85-071f-491a-b52e-3cfd1cf0d695 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.085542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.167118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:36.170897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.171534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.172203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.178777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:36.180871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:36.186494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 64/132] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:35 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:36.187587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.301268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a29f05-f624-4745-93aa-229133722190 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.348775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:36.349825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.350072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.350350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/f8993b31c1f849d2899564c3495501c1/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.352322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f1a8bc8a814143aeb23e059c53bffb, user_id=f8993b31c1f849d2899564c3495501c1, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:36.353870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:36.360556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ecf7-a033-4c2e-80f3-5e58ef79a35c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.375130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 69/133] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:36 2022] PUT /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/f8993b31c1f849d2899564c3495501c1/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:36.376244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.400377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:36.404136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9eba2-0f02-4fd8-ac83-237be4417c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:36.405818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9eba2-0f02-4fd8-ac83-237be4417c0c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.406205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9eba2-0f02-4fd8-ac83-237be4417c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.406559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9eba2-0f02-4fd8-ac83-237be4417c0c None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.408007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9eba2-0f02-4fd8-ac83-237be4417c0c None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:36.411035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9eba2-0f02-4fd8-ac83-237be4417c0c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:36.413170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 65/134] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:36 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:36.415654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610bbe1-a532-4337-b999-3360ffd88f92 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.415947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610bbe1-a532-4337-b999-3360ffd88f92 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.416227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610bbe1-a532-4337-b999-3360ffd88f92 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.418071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 66/135] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:36.423217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610bbe1-a532-4337-b999-3360ffd88f92 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.440680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:36.540896 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82b314-1699-4945-b3b4-d2566b26c769 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.622931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cb0e3-bc99-4651-9937-5dae6016d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:36.627163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb0e3-bc99-4651-9937-5dae6016d230 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.628358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb0e3-bc99-4651-9937-5dae6016d230 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.629771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb0e3-bc99-4651-9937-5dae6016d230 None admin] PATH_INFO: `/v3/projects/272d94a8f40145ee8877ff08a929757f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.632732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cb0e3-bc99-4651-9937-5dae6016d230 None admin] RBAC: Authorizing `identity:get_project(project_id=272d94a8f40145ee8877ff08a929757f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:36.638233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cb0e3-bc99-4651-9937-5dae6016d230 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:36.640639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 70/136] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:36 2022] GET /identity/v3/projects/272d94a8f40145ee8877ff08a929757f => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:36.644305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.645342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610bbe1-a532-4337-b999-3360ffd88f92 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.648163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.649973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.671283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:36.672405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:36.691926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:36.693652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:36.694201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:36.694706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/6addd6a8b31d431899bd0115468c2933/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:36.697789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f1a8bc8a814143aeb23e059c53bffb, user_id=6addd6a8b31d431899bd0115468c2933, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:36.699973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:36.720076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:36 2022] PUT /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/6addd6a8b31d431899bd0115468c2933/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:36.721796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.759547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:36.796645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:36.824790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:36.873385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:36.936657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17196-4af7-4ec4-b651-7a5a24d87a28 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:36.998100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b9f5-574c-4c03-a4a7-8513975cbbd1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:37.020960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf011aa-2f1d-4270-b684-fa32cfb95f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.021919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf011aa-2f1d-4270-b684-fa32cfb95f0f None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.022203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf011aa-2f1d-4270-b684-fa32cfb95f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.022480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf011aa-2f1d-4270-b684-fa32cfb95f0f None admin] PATH_INFO: `/v3/projects/272d94a8f40145ee8877ff08a929757f/users/6addd6a8b31d431899bd0115468c2933/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.024832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf011aa-2f1d-4270-b684-fa32cfb95f0f None admin] RBAC: Authorizing `identity:create_grant(project_id=272d94a8f40145ee8877ff08a929757f, user_id=6addd6a8b31d431899bd0115468c2933, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:37.026342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf011aa-2f1d-4270-b684-fa32cfb95f0f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:37.040346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716c00c-b02c-4d8f-a9dd-5721ca823708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.041567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c00c-b02c-4d8f-a9dd-5721ca823708 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.042017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c00c-b02c-4d8f-a9dd-5721ca823708 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.042467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c00c-b02c-4d8f-a9dd-5721ca823708 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.043878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716c00c-b02c-4d8f-a9dd-5721ca823708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:37.046630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716c00c-b02c-4d8f-a9dd-5721ca823708 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:37.048877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 72/139] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:37.050402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499e89-d0dc-4e74-82ad-b1d65d597b3b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.050874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499e89-d0dc-4e74-82ad-b1d65d597b3b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.051308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499e89-d0dc-4e74-82ad-b1d65d597b3b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.052710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 73/140] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:37.054927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499e89-d0dc-4e74-82ad-b1d65d597b3b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:37.056907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 68/141] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:36 2022] PUT /identity/v3/projects/272d94a8f40145ee8877ff08a929757f/users/6addd6a8b31d431899bd0115468c2933/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:37.058890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.059188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.059476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.081068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:37.082401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:37.150972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:37.161108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 69/142] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:37.174689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499e89-d0dc-4e74-82ad-b1d65d597b3b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:37.193130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:37.251659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.253327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.253926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.255496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.257005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:37.258797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:37.300250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 74/143] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:37 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:37.310706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:37.360389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc316b5d-3c9c-4c16-9c44-ff691f3fce6c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:37.408545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.409734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.410196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.410668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.427501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:37.436306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:37.437343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:37.438115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:37.440440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 70/144] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:37.446878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:37.589386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc61ae-441d-42d9-944a-1fa72fab24f1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:37.625843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.626611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.626928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.627207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.627993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:37.628305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:37.629733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:37.632163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:37.639858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 75/145] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:37.646055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:37.751544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14063d52-1fc8-4fb0-ac3a-451e9bc858c5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:37.777381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:37.787783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.788700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.790213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.790556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] PATH_INFO: `/v3/users/c066af0b1c18463292fb689bf24bdbef` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.791913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] RBAC: Authorizing `identity:get_user(user_id=c066af0b1c18463292fb689bf24bdbef)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:37.793459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:37.795123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 71/146] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:37 2022] GET /identity/v3/users/c066af0b1c18463292fb689bf24bdbef => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:37.800917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:37.909206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997239e-4679-46e3-baba-835adb6b6bc2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:37.944737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcb104-a207-4cdb-84ff-bc230da867f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:37.945657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb104-a207-4cdb-84ff-bc230da867f0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:37.945936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb104-a207-4cdb-84ff-bc230da867f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:37.946209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb104-a207-4cdb-84ff-bc230da867f0 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:37.947439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb104-a207-4cdb-84ff-bc230da867f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:37.948900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb104-a207-4cdb-84ff-bc230da867f0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:37.950830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 76/147] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:37 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:37.956660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:38.064756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2cf99-4bca-4c02-b366-25d152092a53 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:38.099753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc01c9-8a1d-488a-9411-6c7f435fb19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:38.100678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc01c9-8a1d-488a-9411-6c7f435fb19c None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:38.100966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc01c9-8a1d-488a-9411-6c7f435fb19c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:38.101276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc01c9-8a1d-488a-9411-6c7f435fb19c None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/c066af0b1c18463292fb689bf24bdbef/roles/5a0a716f6c914a16ab4b765a8faa97b0` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:38.103405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc01c9-8a1d-488a-9411-6c7f435fb19c None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f1a8bc8a814143aeb23e059c53bffb, user_id=c066af0b1c18463292fb689bf24bdbef, role_id=5a0a716f6c914a16ab4b765a8faa97b0)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:38.104890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc01c9-8a1d-488a-9411-6c7f435fb19c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:38.122211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 72/148] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:37 2022] PUT /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/users/c066af0b1c18463292fb689bf24bdbef/roles/5a0a716f6c914a16ab4b765a8faa97b0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:39.319157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8df24-e616-4ea8-90a5-c7c2010dcacc None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:39.320182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8df24-e616-4ea8-90a5-c7c2010dcacc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:39.320669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8df24-e616-4ea8-90a5-c7c2010dcacc None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:39.322551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 77/149] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:39.328384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:39.329289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:39.329827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:39.351287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:39.352900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:39.412444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:39.441915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 73/150] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:39.498644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8df24-e616-4ea8-90a5-c7c2010dcacc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:39.594103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:39.619740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8df24-e616-4ea8-90a5-c7c2010dcacc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:39.655876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:39.656717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:39.657002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:39.657311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:39.668352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:39.676818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:39.677721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:39.678468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 78/151] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:57:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:39.684303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:39.788403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5adf1a-eb97-4e2b-a74e-b4ac8966a1fe None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:39.826498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:39.827197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:39.827527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:39.827811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:39.828583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:39.828897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:39.830690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:39.839684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 74/152] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:57:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:39.845650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:39.955201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30376b83-f28d-40c0-bf5f-f345ac84136c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:39.981511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:39.991003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d929bc-0f83-47e7-a11e-5c67e8b7bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:39.991948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d929bc-0f83-47e7-a11e-5c67e8b7bb04 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:39.992229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d929bc-0f83-47e7-a11e-5c67e8b7bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:39.992555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d929bc-0f83-47e7-a11e-5c67e8b7bb04 None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:39.993796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d929bc-0f83-47e7-a11e-5c67e8b7bb04 None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:39.995330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d929bc-0f83-47e7-a11e-5c67e8b7bb04 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:39.997001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 79/153] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:39 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:40.003026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:40.062414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:40.124041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98d55f-296d-449a-a996-df82b1402f9e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:40.161261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:40.161942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:40.162226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:40.162504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:40.214830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542302-7f8c-4919-a2b7-86c1ef0d459c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:40.215134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542302-7f8c-4919-a2b7-86c1ef0d459c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:40.215387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542302-7f8c-4919-a2b7-86c1ef0d459c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:40.216799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 80/154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:40.222849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266820-838a-4528-89c3-70b65decba6d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:40.223152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266820-838a-4528-89c3-70b65decba6d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:40.223406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266820-838a-4528-89c3-70b65decba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:40.252364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6d266820-838a-4528-89c3-70b65decba6d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:40.255189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6d266820-838a-4528-89c3-70b65decba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:40.271676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:40.273579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:40.366438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:40.383235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 81/155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:40.424101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266820-838a-4528-89c3-70b65decba6d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:40.495805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 75/156] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:40.520710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:40.547076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266820-838a-4528-89c3-70b65decba6d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:40.577381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:40.593600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:40.594591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:40.594885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:40.595223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:40.611410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:40.628415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:40.629649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:40.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 82/157] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:40.637967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:40.749355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cce13-27e0-498d-85ef-e6208f97fad0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:40.792561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936a60-355d-4700-a688-6fffc82635e1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:40.825787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:40.826820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:40.827103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:40.827377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:40.828648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:40.830731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:40.832664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 76/158] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:40 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:40.843451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:40.844231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:40.844521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:40.844801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:40.845859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:40.846422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:40.847888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:40.857441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:40.862972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 83/159] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:40.873257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:40.886560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:40.965471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:41.041931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b138f6-a2ab-4e6a-b373-e19da74fb13a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:41.097835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deb34c-af95-46c6-bbbb-79c4828618b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:41.098872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb34c-af95-46c6-bbbb-79c4828618b1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.099158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb34c-af95-46c6-bbbb-79c4828618b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.099430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb34c-af95-46c6-bbbb-79c4828618b1 None admin] PATH_INFO: `/v3/users/f8993b31c1f849d2899564c3495501c1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.100850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70deb34c-af95-46c6-bbbb-79c4828618b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8993b31c1f849d2899564c3495501c1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:41.102427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70deb34c-af95-46c6-bbbb-79c4828618b1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:41.104401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f2c4-0853-4f6c-8a59-1d90f2a959cc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:41.104531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 84/160] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:40 2022] GET /identity/v3/users/f8993b31c1f849d2899564c3495501c1 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:41.106934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7235e-59d3-4a4a-b237-63616156547e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.107229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7235e-59d3-4a4a-b237-63616156547e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.107508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7235e-59d3-4a4a-b237-63616156547e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.108918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 85/161] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:41.114186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7235e-59d3-4a4a-b237-63616156547e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:41.229863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:41.230551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.230869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.231152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.232013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] RBAC: Adding query filter params (role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=6addd6a8b31d431899bd0115468c2933) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:41.232333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:41.233823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a9c69-3931-41cf-bf6e-091bcee4454b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:41.240229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 77/162] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:40 2022] GET /identity/v3/role_assignments?user.id=6addd6a8b31d431899bd0115468c2933&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=d0a91103ec054c63b098cc4abec5731f => generated 608 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:41.245565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.245859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.246144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.263049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7235e-59d3-4a4a-b237-63616156547e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:41.290173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:41.291400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:41.291912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:41.314451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:41.315219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.315563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.315961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.412550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 78/163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:41.452983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:41.456584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:41.457472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:41.458676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:41.627000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 86/164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:41.632932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:41.649040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38332916-ff78-4258-ac0d-e5b5e438d0c0 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:41.657433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:41.770657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e3733-95c5-43dc-81c6-ef6c62a27f36 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:41.785891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c8773-08f7-41ce-a4aa-78f71a5d0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:41.786732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c8773-08f7-41ce-a4aa-78f71a5d0218 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.787012 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c8773-08f7-41ce-a4aa-78f71a5d0218 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.787289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c8773-08f7-41ce-a4aa-78f71a5d0218 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.804117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c8773-08f7-41ce-a4aa-78f71a5d0218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:41.823085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:41.823961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.824242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-998c8773-08f7-41ce-a4aa-78f71a5d0218 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:41.824400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:41.825230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:41.826333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:41.826932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.827005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 79/165] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:41.828579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:41.830710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:41.832638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 87/166] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:41 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:41.834580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb44f-d747-49ec-b8c6-515196f1f4a7 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:41.834867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb44f-d747-49ec-b8c6-515196f1f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:41.835143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb44f-d747-49ec-b8c6-515196f1f4a7 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:41.836633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 80/167] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:41.837927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:41.839103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bb44f-d747-49ec-b8c6-515196f1f4a7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:41.960085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:41.977514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:41.987065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf329c-5b7c-449f-a087-e0658d8cf2e7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.006710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bb44f-d747-49ec-b8c6-515196f1f4a7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.052445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:42.053182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.053469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.053746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.054599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=f8993b31c1f849d2899564c3495501c1) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:42.054914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:42.055099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:42.055769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.056056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.056327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.056416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5986853-cf23-4e41-83d8-57a801464bd1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:42.057118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:42.057425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:42.058788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:42.067342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 81/168] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:41 2022] GET /identity/v3/role_assignments?user.id=f8993b31c1f849d2899564c3495501c1&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:42.068476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.068768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.069062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.085410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 88/169] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:42.091329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:42.102259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:42.103503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:42.226539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 82/170] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:42.262375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8153f7-d1a7-436c-b677-93a9ad55f350 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.269202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:42.361881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:42.362808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.363093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.363366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.364726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:42.366242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:42.368320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 89/171] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:42 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:42.374011 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:42.381917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:42.429445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:42.456485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44258-8d29-4513-a0ef-e1f110ddc784 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.522025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9de73-0027-445e-a12b-fba8fffd9635 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.523620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:42.524496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.524798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.525074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.550869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:42.569777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3842-5aca-48a0-89fc-d2ff8bd51c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:42.570295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:42.571320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:42.572281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:42.572996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3842-5aca-48a0-89fc-d2ff8bd51c4f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.572996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3842-5aca-48a0-89fc-d2ff8bd51c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.572996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3842-5aca-48a0-89fc-d2ff8bd51c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.574688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 83/172] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:42.580672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:42.690684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b3842-5aca-48a0-89fc-d2ff8bd51c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:42.698899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b3842-5aca-48a0-89fc-d2ff8bd51c4f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:42.737112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed944c-55d6-4a5b-b754-82667ddebce2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.757428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:42.763683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:42.796294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:42.796959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.797273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.797552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.798324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:42.799048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:42.800474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:42.817399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 84/173] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:42.821060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:42.868878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 90/174] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:42.870564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3aa8-5f2e-4e70-b71a-e4f846659662 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:42.870865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3aa8-5f2e-4e70-b71a-e4f846659662 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:42.871148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3aa8-5f2e-4e70-b71a-e4f846659662 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:42.872491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 91/175] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:42.874363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3aa8-5f2e-4e70-b71a-e4f846659662 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:42.987246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1acfb-7833-483b-aaeb-f78897f7410d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:42.996129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3aa8-5f2e-4e70-b71a-e4f846659662 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.011507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.028029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e05f6a-965a-4400-b67c-7c7046690ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.028993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05f6a-965a-4400-b67c-7c7046690ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.029310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05f6a-965a-4400-b67c-7c7046690ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.029588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05f6a-965a-4400-b67c-7c7046690ee5 None admin] PATH_INFO: `/v3/users/6addd6a8b31d431899bd0115468c2933` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.030774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e05f6a-965a-4400-b67c-7c7046690ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=6addd6a8b31d431899bd0115468c2933)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:43.032229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e05f6a-965a-4400-b67c-7c7046690ee5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:43.033435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40163f83-3be5-4bf9-9864-ecdcb91b068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.038562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 85/176] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:42 2022] GET /identity/v3/users/6addd6a8b31d431899bd0115468c2933 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:43.038681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163f83-3be5-4bf9-9864-ecdcb91b068f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.038681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163f83-3be5-4bf9-9864-ecdcb91b068f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.038681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163f83-3be5-4bf9-9864-ecdcb91b068f None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.038896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.038896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.038896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.039249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163f83-3be5-4bf9-9864-ecdcb91b068f None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:43.040628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163f83-3be5-4bf9-9864-ecdcb91b068f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:43.042410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 92/177] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:42 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:43.043595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494d39-5eab-4821-bb2f-6c6e5005b914 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.043876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494d39-5eab-4821-bb2f-6c6e5005b914 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.044148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494d39-5eab-4821-bb2f-6c6e5005b914 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.045660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 93/178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:43.050525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ad997-e826-4032-b48e-1db41f8aae98 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.050742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ad997-e826-4032-b48e-1db41f8aae98 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.051024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ad997-e826-4032-b48e-1db41f8aae98 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.052899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 94/179] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:43.053705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ad997-e826-4032-b48e-1db41f8aae98 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.061125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:43.062331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:43.109498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.135016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 86/180] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:43.145951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.166520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ad997-e826-4032-b48e-1db41f8aae98 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.200197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18712c-7853-4da6-a889-b7e74eb2c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.200854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18712c-7853-4da6-a889-b7e74eb2c743 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.201161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18712c-7853-4da6-a889-b7e74eb2c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.201436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18712c-7853-4da6-a889-b7e74eb2c743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.249366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.251329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90111d-bc2f-4dce-836e-958b74f38c0d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.275385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18712c-7853-4da6-a889-b7e74eb2c743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:43.276867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18712c-7853-4da6-a889-b7e74eb2c743 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:43.287205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.287865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.288147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.288416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.289275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=6addd6a8b31d431899bd0115468c2933) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:43.289584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:43.291050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529339a6-925c-4b6d-905b-1b31acb7f3a5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:43.296724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 87/181] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/role_assignments?user.id=6addd6a8b31d431899bd0115468c2933&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=c5faf990280443b18b96e64a7fee2798 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:43.297976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.298258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.298553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.323793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:43.324930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:43.366021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.396538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 95/182] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:43.396538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff17bf-326a-4c78-8270-f824b896d4da None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.396538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff17bf-326a-4c78-8270-f824b896d4da None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.396538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff17bf-326a-4c78-8270-f824b896d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.411776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-68ff17bf-326a-4c78-8270-f824b896d4da None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:43.412786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 88/183] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:43.414050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.416858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-68ff17bf-326a-4c78-8270-f824b896d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:43.494537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 96/184] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:43.495981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8a82-fc28-41d8-ba01-7f5ca7c353c4 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.496280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8a82-fc28-41d8-ba01-7f5ca7c353c4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.496558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8a82-fc28-41d8-ba01-7f5ca7c353c4 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.497869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 97/185] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:43.498569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8a82-fc28-41d8-ba01-7f5ca7c353c4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.515654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.532687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0c063-4219-461a-8cc1-3f9548aa2dca None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.576248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.576248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.576248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.576248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.587682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:43.595452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:43.596345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 89/186] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:43.600002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.626900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8a82-fc28-41d8-ba01-7f5ca7c353c4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.632045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.660834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72f5f0-b6e2-42d0-b69a-301046102373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.661762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f5f0-b6e2-42d0-b69a-301046102373 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.662025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f5f0-b6e2-42d0-b69a-301046102373 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.662296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f5f0-b6e2-42d0-b69a-301046102373 None admin] PATH_INFO: `/v3/projects/272d94a8f40145ee8877ff08a929757f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.663469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72f5f0-b6e2-42d0-b69a-301046102373 None admin] RBAC: Authorizing `identity:get_project(project_id=272d94a8f40145ee8877ff08a929757f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:43.664933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72f5f0-b6e2-42d0-b69a-301046102373 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:43.666683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 98/187] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/projects/272d94a8f40145ee8877ff08a929757f => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:43.667813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.668094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.668370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.685315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:43.686502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:43.705669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95b69e-bf7d-4f23-948a-b7e74bea7303 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.739295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.740120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.740400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.740675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.750972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:43.753073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 99/188] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:43.762629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:43.762721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:43.763516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 90/189] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:43.764279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.774402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.856630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:43.865813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18237e-cda4-462b-ae4e-68984c524ff1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.866202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abdfaf-6dbf-4f80-b2d9-8c9bf9722480 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:43.899414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.899589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:43.900224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.900319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:43.900507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.900594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:43.900780 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.900866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:43.901572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:43.901879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:43.903287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:43.911511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:43.912021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 91/190] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:43.912618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:43.919218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:43.920254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 100/191] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:43.921242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:43.990664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.016719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a871867-8b46-4437-93fd-607edf4c1507 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.026433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884ba5d-0931-4cff-a9f8-f47ac3a92290 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.051488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.052148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.052428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.052699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.053570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=272d94a8f40145ee8877ff08a929757f, user.id=6addd6a8b31d431899bd0115468c2933) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:44.053883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.055344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.060755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.061284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 92/192] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/role_assignments?user.id=6addd6a8b31d431899bd0115468c2933&scope.project.id=272d94a8f40145ee8877ff08a929757f&role.id=c5faf990280443b18b96e64a7fee2798 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.061556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.061846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.062121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.062951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:44.063261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.064732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.069746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.074046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 101/193] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.074868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.096352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.191702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28763af9-a921-4585-af28-d565e90497a0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.192071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb7fd9-a1bb-4708-ac5e-a1d8fd981e77 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.223851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.229743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.230818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.230930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.231340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.231745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.231919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.232016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.232291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] PATH_INFO: `/v3/users/8033c422b46c45d081d72de0bdcd771c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.233556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.235215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.237454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 93/194] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.238431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.249825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] RBAC: Authorizing `identity:get_user(user_id=8033c422b46c45d081d72de0bdcd771c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.251324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.253282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 102/195] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/users/8033c422b46c45d081d72de0bdcd771c => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.254095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.343048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.359299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2bc2b-e274-428f-99bb-0e758b5c50b3 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.369712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31a191-0bce-4914-b443-227cae1fa7e9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.392660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.393297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.393580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.393869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.394619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:44.394930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.396324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.404692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 94/196] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.405546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.405684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.406462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.406729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.407004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] PATH_INFO: `/v3/users/8033c422b46c45d081d72de0bdcd771c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.408227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] RBAC: Authorizing `identity:get_user(user_id=8033c422b46c45d081d72de0bdcd771c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.409988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.411646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 103/197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/users/8033c422b46c45d081d72de0bdcd771c => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.412414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.467464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.507732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68d847-6994-4a3a-83b9-862e004de288 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a53f83-bf54-42e0-8068-fb3e65aa4520 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.541468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.542140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.542424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.542695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.543386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.544956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.545921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.546590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.546857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.547134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.571504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 95/198] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:44 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:44.572334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.588910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.642617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.644584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.708613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0aa3d-0ce8-4af9-b1e0-8ed56b8d6b37 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.709118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.750852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.751872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.752261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.752883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] PATH_INFO: `/v3/users/c066af0b1c18463292fb689bf24bdbef` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.754429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] RBAC: Authorizing `identity:get_user(user_id=c066af0b1c18463292fb689bf24bdbef)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:44.756775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:44.758709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 96/199] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/users/c066af0b1c18463292fb689bf24bdbef => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:44.759345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.764037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 104/200] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:44.764639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:44.851363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:44.881288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551fb6-7aa8-4a4b-908a-1e8cef3c816f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.889041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c46d9-2752-4c9c-a45b-04e1c8a2aaac None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:44.925601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.926295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.926581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.926863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.930715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:44.931389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:44.931672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:44.931948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:44.961770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:45.012292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.013731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.024937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.026875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.087498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:45.121699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:45.122580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:45.130018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 105/202] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:45.130951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:45.205576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:45.228554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89383f-9478-4414-9008-f19c571aaead None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:45.231976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408dcbb-6e16-4a80-941d-6fbb3446c0dd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:45.265848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:45.267086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:45.267610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:45.268081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:45.268845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:45.269925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:45.270124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.270203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:45.270461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:45.271657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.272243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.273496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.274772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 98/203] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:45 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:45.275300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 106/204] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:45 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:45.275906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:45.285117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:45.332308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:45.395534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef52-4a8e-4f74-a072-420540014443 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:45.430919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107ed16-c0b1-4471-b449-bd92415d2d95 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:45.434079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:45.435162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:45.435647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:45.436095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:45.437527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.439552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.441560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 99/205] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:45 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:45.442536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:45.465667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:45.480325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:45.481354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:45.481813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:45.482260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:45.483305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] RBAC: Adding query filter params (role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=8033c422b46c45d081d72de0bdcd771c) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:45.483898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.485647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.492401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 107/206] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:45 2022] GET /identity/v3/role_assignments?user.id=8033c422b46c45d081d72de0bdcd771c&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=d0a91103ec054c63b098cc4abec5731f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:45.493677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:45.613798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c1714-565a-4867-af0a-e35d4b7fd70e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:45.627075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:45.631652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c80e-3ffc-4cbb-93ba-68f6a62a675d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:45.661921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:45.662970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:45.663444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:45.663899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:45.664964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=8033c422b46c45d081d72de0bdcd771c) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:45.665503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.667253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220019-26c2-48de-87ea-9c9a1b629697 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.674519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 100/207] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:45 2022] GET /identity/v3/role_assignments?user.id=8033c422b46c45d081d72de0bdcd771c&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:45.681778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:45.682454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:45.682734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:45.683007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:45.683865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] RBAC: Adding query filter params (role.id=5a0a716f6c914a16ab4b765a8faa97b0, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb, user.id=c066af0b1c18463292fb689bf24bdbef) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:45.684177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:45.685994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff4556-a0fe-4d6d-be12-e12b0f4fe591 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:45.694411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 108/208] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:45 2022] GET /identity/v3/role_assignments?user.id=c066af0b1c18463292fb689bf24bdbef&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=5a0a716f6c914a16ab4b765a8faa97b0 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:47.117592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fced21-203a-4446-b392-a65d67b35857 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.118615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fced21-203a-4446-b392-a65d67b35857 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.119102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fced21-203a-4446-b392-a65d67b35857 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.120699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 101/209] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:47.126228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc7f17-9c70-4a59-8539-2eaade3676cb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.126689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc7f17-9c70-4a59-8539-2eaade3676cb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.126855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc7f17-9c70-4a59-8539-2eaade3676cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.144146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-64bc7f17-9c70-4a59-8539-2eaade3676cb None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:47.145399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-64bc7f17-9c70-4a59-8539-2eaade3676cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:47.194752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:47.215966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 109/210] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:47.240001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fced21-203a-4446-b392-a65d67b35857 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:47.255084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a178-3769-426d-894b-f913a19f7705 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.255621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a178-3769-426d-894b-f913a19f7705 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.256243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a178-3769-426d-894b-f913a19f7705 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.257963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 110/211] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:47.262995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.263331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.263562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.281489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:47.282633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:47.355607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:47.369155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fced21-203a-4446-b392-a65d67b35857 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:47.379760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:47.412200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:47.413933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.414647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.415115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.416742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:47.419441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:47.421773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 102/213] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:47.427664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:47.471398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:47.492677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b409f92-e2e0-4cdb-af81-407b8a9650a6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:47.507304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:47.531965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:47.532815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.533143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.533422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.533910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2839d0-18a9-4ca2-8723-a3aacd65ecd7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:47.544853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:47.553691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:47.554567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:47.555337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 112/214] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:47.560705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:47.573950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:47.574984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.575458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.576905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:47.578754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:47.604204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 103/215] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:47 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:57:47.697461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2bde9-84dd-44b3-b5c9-71da45efb70f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:47.744648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:47.745379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.745662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.745935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.746745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:47.747044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:47.748479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:47.759490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 113/216] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:47.765485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:47.876000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:47.882192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0d16-31da-4d02-9620-002d99afc01f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:47.922210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8975a0-fb8c-42b3-a57c-6a5558517500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:47.923171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8975a0-fb8c-42b3-a57c-6a5558517500 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:47.923471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8975a0-fb8c-42b3-a57c-6a5558517500 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:47.923744 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8975a0-fb8c-42b3-a57c-6a5558517500 None admin] PATH_INFO: `/v3/users/50b773623df2471682fbb0caa4099b97` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:47.938319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8975a0-fb8c-42b3-a57c-6a5558517500 None admin] RBAC: Authorizing `identity:get_user(user_id=50b773623df2471682fbb0caa4099b97)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:47.939849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8975a0-fb8c-42b3-a57c-6a5558517500 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:47.942009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 104/217] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:47 2022] GET /identity/v3/users/50b773623df2471682fbb0caa4099b97 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:47.947220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:47.989361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:48.071940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007ca42-df2c-4b9f-92c4-641843e496c4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.109719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.110394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.110654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b7fd-8e3e-436f-ae39-b140bb80bc6b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.110750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.110986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b7fd-8e3e-436f-ae39-b140bb80bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.111128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.111353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b7fd-8e3e-436f-ae39-b140bb80bc6b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.113131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 105/218] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:48.121863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4e83-d71b-4b2a-a112-b79e0b850496 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.122439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4e83-d71b-4b2a-a112-b79e0b850496 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.122439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4e83-d71b-4b2a-a112-b79e0b850496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.144147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-aabc4e83-d71b-4b2a-a112-b79e0b850496 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:48.145394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-aabc4e83-d71b-4b2a-a112-b79e0b850496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:48.187998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:48.190716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:48.217052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 106/219] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:48.218445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e752c-4a92-46b1-8ef5-cf6a4c88db79 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.218733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e752c-4a92-46b1-8ef5-cf6a4c88db79 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.219013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e752c-4a92-46b1-8ef5-cf6a4c88db79 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.220313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 107/220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:48.230831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.231124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.231374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.244157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:48.260947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:48.262165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:48.315522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 114/221] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:57:48.316407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.342739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 108/222] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:48.349354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.365942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:48.426552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d62b08-9989-4733-8424-4ce4ab27acc7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.456302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac111e1-f22c-41af-96bb-70686da81938 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.461276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.462111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.462394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.462670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.469441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:48.477962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:48.490454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:48.491324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:48.492093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 115/223] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:48.493295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.501152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.502038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.502313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.502589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.504360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:48.506471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:48.513189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 109/224] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:48.515362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.609104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad7d8f-5f5e-4cb7-8841-729b3b4e068a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.624699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:48.650081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.650296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a279c1-f5c4-4954-8b41-ccb57d482ad2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.651287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.651705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.652147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.663596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:48.671828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:48.672675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:48.673509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:48.675898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 116/225] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:48.676911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.697134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.698157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.698628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.699102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.700048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:48.700563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:48.702197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:48.712046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 110/226] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:48.713242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.759219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:48.814238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b22d-950f-4bed-86ab-d4705a203303 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.843581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db240-7289-47ee-9677-239ff54df72a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:48.849828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.850720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.851191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.851694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.852733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=50b773623df2471682fbb0caa4099b97) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:48.853262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:48.854894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:48.861216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 117/227] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/role_assignments?user.id=50b773623df2471682fbb0caa4099b97&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=c5faf990280443b18b96e64a7fee2798 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:48.862393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.911816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:48.912927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:48.913457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:48.913918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:48.914894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:48.915395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:48.917143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:48.927167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 111/228] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:48.933240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:48.952056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:49.015956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ffdf-c2bb-4593-9a53-a68f7e4a658a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:49.038459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:49.060894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:49.062724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:49.063210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:49.063763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] PATH_INFO: `/v3/users/8033c422b46c45d081d72de0bdcd771c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:49.065734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] RBAC: Authorizing `identity:get_user(user_id=8033c422b46c45d081d72de0bdcd771c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:49.067733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:49.069731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 118/229] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/users/8033c422b46c45d081d72de0bdcd771c => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:49.076440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:49.183441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df21bd-86a4-4e82-bf9a-cbef82b22b77 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:49.200324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82096b5-9ec3-485d-8131-0a944bbb4c42 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:49.231346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:49.232849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:49.233383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:49.233870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] PATH_INFO: `/v3/users/8033c422b46c45d081d72de0bdcd771c` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:49.235287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] RBAC: Authorizing `identity:get_user(user_id=8033c422b46c45d081d72de0bdcd771c)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:49.236979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:49.239338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 112/230] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:48 2022] GET /identity/v3/users/8033c422b46c45d081d72de0bdcd771c => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:49.248826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:49.262229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:49.263123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:49.263477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:49.263891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:49.265121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:49.266631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:49.268327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 119/231] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:49 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:49.274465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:49.377821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:49.389388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:49.419298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d702d-c20e-43a9-bb8c-21505e7caf4b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:49.451040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fc2ce-1a29-4e0b-8328-53227ab20967 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:49.454035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:49.455107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:49.455392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:49.455663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:49.456851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:49.458329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:49.460040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 113/232] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:49 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:49.471117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:49.523630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a05b62-59ac-4d84-80fa-cb7cdbf6cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:49.524457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a05b62-59ac-4d84-80fa-cb7cdbf6cd26 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:49.524733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a05b62-59ac-4d84-80fa-cb7cdbf6cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:49.525004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a05b62-59ac-4d84-80fa-cb7cdbf6cd26 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/8033c422b46c45d081d72de0bdcd771c/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:49.527563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a05b62-59ac-4d84-80fa-cb7cdbf6cd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99d47b4a88c4a968eeb402c6a7c1a71, user_id=8033c422b46c45d081d72de0bdcd771c, role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:49.529331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a05b62-59ac-4d84-80fa-cb7cdbf6cd26 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:49.546708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 120/233] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:49 2022] PUT /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/8033c422b46c45d081d72de0bdcd771c/roles/d0a91103ec054c63b098cc4abec5731f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:49.646876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27dc49-febf-4277-ab59-99314de66ca2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:49.683631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c610-fe47-4429-8089-3c62f4012ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:49.684598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c610-fe47-4429-8089-3c62f4012ccf None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:49.684889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c610-fe47-4429-8089-3c62f4012ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:49.685195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c610-fe47-4429-8089-3c62f4012ccf None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/8033c422b46c45d081d72de0bdcd771c/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:49.687407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c610-fe47-4429-8089-3c62f4012ccf None admin] RBAC: Authorizing `identity:create_grant(project_id=b99d47b4a88c4a968eeb402c6a7c1a71, user_id=8033c422b46c45d081d72de0bdcd771c, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:49.688988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c610-fe47-4429-8089-3c62f4012ccf None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:49.707837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 114/234] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:49 2022] PUT /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/8033c422b46c45d081d72de0bdcd771c/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 12:57:50.286503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163f28-e419-4d23-98eb-80055f846212 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:50.287544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163f28-e419-4d23-98eb-80055f846212 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:50.288021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163f28-e419-4d23-98eb-80055f846212 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:50.289634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 121/235] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:50.295229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b5fb-d32c-4042-9b50-4d92519da69e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:50.295634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b5fb-d32c-4042-9b50-4d92519da69e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:50.295798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b5fb-d32c-4042-9b50-4d92519da69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:50.301113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:50.314486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6e20b5fb-d32c-4042-9b50-4d92519da69e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:50.316824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6e20b5fb-d32c-4042-9b50-4d92519da69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:50.388445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 115/236] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:50.424501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163f28-e419-4d23-98eb-80055f846212 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:50.543459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163f28-e419-4d23-98eb-80055f846212 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:50.554529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585f6c5-8e73-4d97-a71c-ad014179fe67 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:50.555068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585f6c5-8e73-4d97-a71c-ad014179fe67 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:50.555581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585f6c5-8e73-4d97-a71c-ad014179fe67 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:50.557345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 116/237] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:50.560977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:50.563218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:50.564131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:50.564618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:50.583868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:50.584688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:50.584973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:50.585275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:50.596261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:50.597796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:50.618811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:50.626908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:50.627746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:50.628496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:50.632800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 122/238] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:50.638663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:50.732253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 117/239] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:50.784864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:50.823247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144525f3-bc31-4ddf-93be-8933ec4b6a36 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:50.869520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:50.869798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:50.870675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:50.871101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:50.871518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:50.872443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:50.872897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:50.874548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:50.884589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 123/240] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:50.893246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:50.948002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75e9c6-ec56-4cd9-aef9-6af9d38795c4 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:50.994044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:51.003163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.004215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.004664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.005120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.006447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:51.008981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:51.010808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 118/241] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:51.019199 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:51.143627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720a9d-24ac-4621-93f8-4e5b70eb2557 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:51.146380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387c1c4-8829-4c33-8459-90a96f4b74ec None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:51.183730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.184859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.185302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.185734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] PATH_INFO: `/v3/users/85da03e7d89f40939cacf1ff30b0434d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.190543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:51.197169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d083eb-7b33-499f-833f-5fa2c6728473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.197861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d083eb-7b33-499f-833f-5fa2c6728473 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.198158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d083eb-7b33-499f-833f-5fa2c6728473 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.198454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d083eb-7b33-499f-833f-5fa2c6728473 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.199180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d083eb-7b33-499f-833f-5fa2c6728473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:51.200642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d083eb-7b33-499f-833f-5fa2c6728473 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:51.201593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] RBAC: Authorizing `identity:get_user(user_id=85da03e7d89f40939cacf1ff30b0434d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:51.203188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:51.205298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 124/242] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:50 2022] GET /identity/v3/users/85da03e7d89f40939cacf1ff30b0434d => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:51.214217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:51.228630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 119/243] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:51 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:51.382462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:51.390395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084bdb0-26f8-4429-8379-88571fbdf4ba None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:51.437155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.438120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.438575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.439171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.525672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:51.527477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:51.622044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81f778-0035-4ac8-9bfc-9c877709bd31 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.622998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81f778-0035-4ac8-9bfc-9c877709bd31 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.623492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81f778-0035-4ac8-9bfc-9c877709bd31 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.626110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 120/244] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:51.634354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.634941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.635418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.641750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:51.652113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 125/245] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:51.656110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:51.660997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:51.662486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:51.736007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 121/246] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:51.758387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:51.765968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b5af5-95d7-412e-808c-17115fe21efe None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:51.801683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.802810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.803229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.803690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.805118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:51.806718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:51.808590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 126/247] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:51 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:51.814951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:51.870519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5c566-9a5f-4a5f-802f-83fe99dbd261 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:51.879414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:51.889207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:51.912187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.913521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.914025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.914610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.922856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c6ef-a371-44d4-9d8c-b8eb36e601d4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:51.926931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:51.935628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:51.936516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:51.937357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:51.940102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 122/248] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:51.945951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:51.961778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:51.962463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:51.962742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:51.963015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:51.963868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] RBAC: Adding query filter params (role.id=5a0a716f6c914a16ab4b765a8faa97b0, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=85da03e7d89f40939cacf1ff30b0434d) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:51.964180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:51.965649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:51.971784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 127/249] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:51 2022] GET /identity/v3/role_assignments?user.id=85da03e7d89f40939cacf1ff30b0434d&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=5a0a716f6c914a16ab4b765a8faa97b0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:52.065594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2b2aa-70f3-4af3-bfcf-4276e1d66e98 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:52.104337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:52.105160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.105444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.105723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.106512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:52.106819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:52.108306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:52.118327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 123/250] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:52.123600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:52.263623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14bd53-aa9f-4b68-9ce7-bd55f1aff69b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:52.295232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:52.304824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:52.306210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.306687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.307149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] PATH_INFO: `/v3/users/50b773623df2471682fbb0caa4099b97` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.308538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=50b773623df2471682fbb0caa4099b97)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:52.310229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:52.312087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 128/251] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:52 2022] GET /identity/v3/users/50b773623df2471682fbb0caa4099b97 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:52.317808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:52.377407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:52.461112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702e39-7e37-46c6-aaac-a2d04433b9e5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:52.513736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd77d3-000c-493d-b20a-352e262be25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:52.514666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd77d3-000c-493d-b20a-352e262be25b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.514949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd77d3-000c-493d-b20a-352e262be25b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.515217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd77d3-000c-493d-b20a-352e262be25b None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.519953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd77d3-000c-493d-b20a-352e262be25b None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:52.521473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd77d3-000c-493d-b20a-352e262be25b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:52.523795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 124/252] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:52 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:52.529333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:52.598920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252776-228f-481b-89e2-d41f352af18e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.599209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252776-228f-481b-89e2-d41f352af18e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.599382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252776-228f-481b-89e2-d41f352af18e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.600814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 125/253] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:52.606194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.606475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.606754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.641992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:52.644113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:52.760061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81062a2-9b62-4e07-8696-89db67147bd1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:52.779405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 126/254] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:52.810311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:52.836473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf557106-e334-4fbf-a38c-8823bfb25c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:52.837677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf557106-e334-4fbf-a38c-8823bfb25c09 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.838121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf557106-e334-4fbf-a38c-8823bfb25c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.838545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf557106-e334-4fbf-a38c-8823bfb25c09 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/50b773623df2471682fbb0caa4099b97/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.846031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf557106-e334-4fbf-a38c-8823bfb25c09 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99d47b4a88c4a968eeb402c6a7c1a71, user_id=50b773623df2471682fbb0caa4099b97, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:52.847909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf557106-e334-4fbf-a38c-8823bfb25c09 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:52.868092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:52.876253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 129/255] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:52 2022] PUT /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/50b773623df2471682fbb0caa4099b97/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:57:52.960016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c26b4-472c-4711-ba32-00a1884bf471 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:52.980990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33dca-2ccd-413c-bd8c-098ddf0e2289 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.981589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33dca-2ccd-413c-bd8c-098ddf0e2289 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.982030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33dca-2ccd-413c-bd8c-098ddf0e2289 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:52.983608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 130/256] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:52.989059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:52.989627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:52.990187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.001270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:53.002390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:53.002676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:53.002951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.027148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:53.028401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:53.029858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:53.041054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:53.042023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:53.042779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 127/257] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:57:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:53.048576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:53.113384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:53.149662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 131/258] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:53.195585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:53.242444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:53.255272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b929-6594-4547-ac51-7a2cc12fb242 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:53.316044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:53.316762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:53.317065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:53.317348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.318118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:53.318432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:53.319829 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:53.337651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 128/259] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:57:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:53.349762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:53.430994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8004ef-838e-4005-bf9b-ca3929c1dbbc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:53.475333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0601d-606c-4754-8331-f751c866b414 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:53.533998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:53.534832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:53.535114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:53.535390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.536581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:53.537628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:53.537912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:53.538187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] PATH_INFO: `/v3/users/8033c422b46c45d081d72de0bdcd771c` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.539499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] RBAC: Authorizing `identity:get_user(user_id=8033c422b46c45d081d72de0bdcd771c)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:53.540971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:53.542661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:53 2022] GET /identity/v3/users/8033c422b46c45d081d72de0bdcd771c => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:53.551405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:53.561991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:53.571640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:53.572594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:53.573410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:53.589714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:53.631764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:53.674226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:53.696675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52745e-a397-4c00-8336-aae1604c3220 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:53.754180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:53.754940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:53.755228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:53.755603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.783344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84536-7983-499a-9916-cb809e9deba0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:53.859955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:53.860657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:53.860966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:53.861274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:53.862110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:53.862424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:53.863828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:53.873904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:53.875410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:53.881440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 133/262] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:53.894191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:53.922160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:54.066380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 130/263] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:57:54.074150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:54.150412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9da9-accb-4654-9fe6-be2d2b8fd01d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:54.163420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:54.213728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:54.214660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:54.214939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:54.215216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] PATH_INFO: `/v3/users/8033c422b46c45d081d72de0bdcd771c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:54.217397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] RBAC: Authorizing `identity:get_user(user_id=8033c422b46c45d081d72de0bdcd771c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:54.218856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:54.220590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 134/264] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:53 2022] GET /identity/v3/users/8033c422b46c45d081d72de0bdcd771c => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:54.228255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:54.262461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf4abb-dfc4-43bd-af1b-8f5b94643a66 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:54.340919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:54.374323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:54.375221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:54.375506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:54.375785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:54.377053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:54.378691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:54.380618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:54 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:54.388288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:54.460003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd8394-a796-483a-81f5-7a44a2b69c7f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:54.528535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:54.529420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:54.529746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:54.530018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:54.596376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fca0f-b55b-43c4-9a55-39e085a8b9dd None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:54.617637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:54.681036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:54.681036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:54.681036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:54.681036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:54.681462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] RBAC: Adding query filter params (role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=8033c422b46c45d081d72de0bdcd771c) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:54.681699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:54.683137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:54.686152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:54.687889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:54.703817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 132/266] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:54 2022] GET /identity/v3/role_assignments?user.id=8033c422b46c45d081d72de0bdcd771c&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=d0a91103ec054c63b098cc4abec5731f => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:54.864903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 135/267] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:57:54.870935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:54.948517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:54.991761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfeeef-9cd1-4d25-8c14-5ad464e8e24f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.028107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cc596-7a7a-4ba0-ba9c-10205bbaaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.029003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cc596-7a7a-4ba0-ba9c-10205bbaaabf None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.029358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cc596-7a7a-4ba0-ba9c-10205bbaaabf None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.029636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cc596-7a7a-4ba0-ba9c-10205bbaaabf None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.030888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cc596-7a7a-4ba0-ba9c-10205bbaaabf None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:55.032459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cc596-7a7a-4ba0-ba9c-10205bbaaabf None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:55.035041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 133/268] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:54 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:55.040856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.105854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4f81-477b-4250-8b16-5e1c17480ee0 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.106164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4f81-477b-4250-8b16-5e1c17480ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.106422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4f81-477b-4250-8b16-5e1c17480ee0 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.107799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 134/269] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:55.122401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcf482-4b80-4a96-9571-21f3ea72f2e4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.122669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcf482-4b80-4a96-9571-21f3ea72f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.122871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcf482-4b80-4a96-9571-21f3ea72f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.140880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f4dcf482-4b80-4a96-9571-21f3ea72f2e4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:55.142119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f4dcf482-4b80-4a96-9571-21f3ea72f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:55.166365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:55.195132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4c2a-368c-486f-8649-ad30469b3187 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.214224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 135/270] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:55.220210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d3fec-0070-45e0-8615-e3218a689e00 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.220661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d3fec-0070-45e0-8615-e3218a689e00 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.220945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d3fec-0070-45e0-8615-e3218a689e00 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.222453 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 136/271] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:55.228965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb956-cb2d-45ad-8470-d6cc55e4f9c3 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.229537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb956-cb2d-45ad-8470-d6cc55e4f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.230038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb956-cb2d-45ad-8470-d6cc55e4f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.246670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.247356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.247637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.247909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.248777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=8033c422b46c45d081d72de0bdcd771c) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:55.249341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:55.250589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:55.253264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9a7cb956-cb2d-45ad-8470-d6cc55e4f9c3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:55.254728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9a7cb956-cb2d-45ad-8470-d6cc55e4f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:55.257920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 136/272] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/role_assignments?user.id=8033c422b46c45d081d72de0bdcd771c&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:55.258762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.315140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:55.336006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 137/273] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:57:55.337717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd630c5-ae5e-4a01-9d8d-d4698587b50e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.338202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd630c5-ae5e-4a01-9d8d-d4698587b50e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.338665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd630c5-ae5e-4a01-9d8d-d4698587b50e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.340402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 138/274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:55.352954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.353967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.354594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.380029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:55.382156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:55.413870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4883f4c-b608-4d21-81d0-9e71e98508f5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.460948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.461959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.462341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.462869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.472588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 139/275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:55.473850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.477981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:55.492484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:55.502190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:55.503153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:55.503904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:55.504486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 137/276] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:55.510798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.620675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ae6bf-f02f-4ca1-a525-f8bab2d30af5 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.632398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7635f-48a5-4da6-91b9-0a8af713d9e9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.641515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:55.661519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.662332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.662615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.662890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.664055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:55.665589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:55.671535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 140/277] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:55.671535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.673130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.674110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.674600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.675060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.676005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:55.676490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:55.678095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:55.687444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 138/278] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:55.688333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.754941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:55.783286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805ead6-d91a-4305-94f7-3e41e56b051e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.806306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c61d-ffc5-4ffa-b792-f0b98ee43075 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:55.820869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.821711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.822044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.822319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.833033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:55.840791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:55.841861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 141/279] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:55.845830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.849224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87486d4-f135-4b25-9035-344812618264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:55.849927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87486d4-f135-4b25-9035-344812618264 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:55.850213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87486d4-f135-4b25-9035-344812618264 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:55.850493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87486d4-f135-4b25-9035-344812618264 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:55.851259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87486d4-f135-4b25-9035-344812618264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:55.852731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87486d4-f135-4b25-9035-344812618264 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:55.879707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 139/280] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:57:55 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:57:55.880805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87486d4-f135-4b25-9035-344812618264 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:55.903424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:55.987190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346ba5-7644-4ee4-a42f-cd69005e19f3 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.020025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87486d4-f135-4b25-9035-344812618264 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.038346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.039282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.039986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:56.040092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.041042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] PATH_INFO: `/v3/users/85da03e7d89f40939cacf1ff30b0434d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.042173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] RBAC: Authorizing `identity:get_user(user_id=85da03e7d89f40939cacf1ff30b0434d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:56.044417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:56.046224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 142/281] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/users/85da03e7d89f40939cacf1ff30b0434d => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:56.052432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:56.067985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.069126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.069626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.070087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.071063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:56.071563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:56.073248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:56.083213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 140/282] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:56.089563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:56.178175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9e05e-d6c2-47d2-94e1-b0db967a238e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.198435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:56.216573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92805056-97c1-4a5a-91a8-40a03c0da9ec None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.226191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.227067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.227346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.227617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.228790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:56.230294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:56.236642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 143/283] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:56 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:56.238200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:56.257377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.258277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.258578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.258832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] PATH_INFO: `/v3/users/6252729de2d746238a4a254c1e185a3a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.277996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] RBAC: Authorizing `identity:get_user(user_id=6252729de2d746238a4a254c1e185a3a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:56.280375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:56.285102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 141/284] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:56 2022] GET /identity/v3/users/6252729de2d746238a4a254c1e185a3a => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:56.296523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:56.340948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:56.372696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4040e69-85d7-4072-969a-c578db0accf3 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.415544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ba530-d566-4b97-ae90-cd28c13ba669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.416451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ba530-d566-4b97-ae90-cd28c13ba669 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.416735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ba530-d566-4b97-ae90-cd28c13ba669 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.417028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ba530-d566-4b97-ae90-cd28c13ba669 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/85da03e7d89f40939cacf1ff30b0434d/roles/5a0a716f6c914a16ab4b765a8faa97b0` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.419032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ba530-d566-4b97-ae90-cd28c13ba669 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99d47b4a88c4a968eeb402c6a7c1a71, user_id=85da03e7d89f40939cacf1ff30b0434d, role_id=5a0a716f6c914a16ab4b765a8faa97b0)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:56.420510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ba530-d566-4b97-ae90-cd28c13ba669 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:56.426608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62cdd5-bc9d-483f-b762-918731d41626 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.437636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 144/285] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:57:56 2022] PUT /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/users/85da03e7d89f40939cacf1ff30b0434d/roles/5a0a716f6c914a16ab4b765a8faa97b0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 12:57:56.439596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc286-daf4-49f9-b9b4-52e40b48769a None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.440576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc286-daf4-49f9-b9b4-52e40b48769a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.441151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc286-daf4-49f9-b9b4-52e40b48769a None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.442894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 145/286] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:56.455683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.456300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.456723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.493744 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:56.495717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:56.496514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.497508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.497956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.498371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.499382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, user.id=6252729de2d746238a4a254c1e185a3a, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:56.499860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:56.504676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:56.516737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 142/287] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jun 7 12:57:56 2022] GET /identity/v3/role_assignments?user.id=6252729de2d746238a4a254c1e185a3a&scope.system=all&role.id=c5faf990280443b18b96e64a7fee2798 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:56.555803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:56.600622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 146/288] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:56.625465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:56.786036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea906-dcee-4c65-9849-e940f09f2c3d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:56.801454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:56.830159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:56.831346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:56.831832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:56.832324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:56.844091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:56.852365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:56.853263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:56.854029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:56.856391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 143/289] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:56.862566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:56.966464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e34e-4ccf-4880-96c1-d4a02a0fdc68 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:57.002421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:57.003348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:57.003800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:57.004208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:57.005265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:57.005746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:57.007280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:57.016779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 147/290] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:57.022630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:57.149600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b7d1-5f48-4c34-a4b4-bb71aeaa87e3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:57.193049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:57.194321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:57.194838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:57.195309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] PATH_INFO: `/v3/users/50b773623df2471682fbb0caa4099b97` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:57.196723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] RBAC: Authorizing `identity:get_user(user_id=50b773623df2471682fbb0caa4099b97)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:57.198447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:57.200306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 144/291] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:57 2022] GET /identity/v3/users/50b773623df2471682fbb0caa4099b97 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:57:57.206352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:57.254086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:57.334428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c9b70-ba5f-4959-ad0e-943391671bd7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:57.380650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:57.381338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:57.381608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:57.381883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:57.451466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:57.452984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:57.485616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:57.561432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 148/292] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:57:57.567107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:57.609913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:57.711526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeb439-40c4-410e-89b6-aaa803b2de4e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:57.756094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47172161-71ce-4d93-962a-808c3d7ebdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:57.757368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172161-71ce-4d93-962a-808c3d7ebdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:57.757874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172161-71ce-4d93-962a-808c3d7ebdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:57.758346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172161-71ce-4d93-962a-808c3d7ebdb7 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:57.759754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172161-71ce-4d93-962a-808c3d7ebdb7 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:57.761500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172161-71ce-4d93-962a-808c3d7ebdb7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:57.763444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 145/293] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:57:57 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:57.774232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:57.877575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de1e88-52e1-4ddf-a661-e516fcc58687 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:57.906616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:57.912192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:57.912901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:57.913356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:57.913523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:57.914466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=50b773623df2471682fbb0caa4099b97) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:57.914775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:57.916671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca110-96b9-428c-bc8e-1ac8825358d1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:57.927541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 149/294] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:57:57 2022] GET /identity/v3/role_assignments?user.id=50b773623df2471682fbb0caa4099b97&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=c5faf990280443b18b96e64a7fee2798 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:58.706608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabf29e-fc51-4e7a-be74-a322247af91d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:58.707529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabf29e-fc51-4e7a-be74-a322247af91d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:58.707986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabf29e-fc51-4e7a-be74-a322247af91d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:58.709644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 146/295] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:58.715244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb9a7-52ce-41af-acba-2690ac9a8337 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:58.715532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb9a7-52ce-41af-acba-2690ac9a8337 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:58.716086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb9a7-52ce-41af-acba-2690ac9a8337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:58.734116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8c4fb9a7-52ce-41af-acba-2690ac9a8337 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:58.735674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8c4fb9a7-52ce-41af-acba-2690ac9a8337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:58.804145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 150/296] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:58.826793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabf29e-fc51-4e7a-be74-a322247af91d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:58.935604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:58.943772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabf29e-fc51-4e7a-be74-a322247af91d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:58.956301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2fb5-56a4-4ad0-b62c-705e5b4e280b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:58.957317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2fb5-56a4-4ad0-b62c-705e5b4e280b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:58.957790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2fb5-56a4-4ad0-b62c-705e5b4e280b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:58.959652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 151/297] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:58.964546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:58.965095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:58.965607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:58.983414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:58.983691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:58.984432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:58.984708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:58.984977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:58.985874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:58.986159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:58.987603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:58.993085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 147/298] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:58.995528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.061444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:59.084311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.111024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea962-4e3c-4665-9b58-de1506468947 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.141963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.151459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9be066-8a52-4f7a-b9d1-a13df9b354ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.152153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9be066-8a52-4f7a-b9d1-a13df9b354ea None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.152437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9be066-8a52-4f7a-b9d1-a13df9b354ea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.152962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9be066-8a52-4f7a-b9d1-a13df9b354ea None admin] PATH_INFO: `/v3/groups` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.153747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9be066-8a52-4f7a-b9d1-a13df9b354ea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:59.156077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9be066-8a52-4f7a-b9d1-a13df9b354ea None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:59.182951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 148/300] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jun 7 12:57:58 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:57:59.200325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b280f84-ffad-4fae-a5be-1628fed45896 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.241761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98446fc3-776a-494b-b715-c8da84c4f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.242613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446fc3-776a-494b-b715-c8da84c4f329 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.242895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446fc3-776a-494b-b715-c8da84c4f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.243163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446fc3-776a-494b-b715-c8da84c4f329 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.256635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98446fc3-776a-494b-b715-c8da84c4f329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-98446fc3-776a-494b-b715-c8da84c4f329 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:59.265196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:59.266154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:59.266913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:57:59.267553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b9b1-28f4-4cfe-9d52-13c884e27c45 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.267553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b9b1-28f4-4cfe-9d52-13c884e27c45 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.267553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b9b1-28f4-4cfe-9d52-13c884e27c45 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.267724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 153/301] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:57:59.267788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 149/302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:57:59.273153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84ac1-38a7-4cb1-8af5-5e958bbe5372 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.273465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84ac1-38a7-4cb1-8af5-5e958bbe5372 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.273763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84ac1-38a7-4cb1-8af5-5e958bbe5372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.276753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b9b1-28f4-4cfe-9d52-13c884e27c45 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.299642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c4a84ac1-38a7-4cb1-8af5-5e958bbe5372 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:59.300865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c4a84ac1-38a7-4cb1-8af5-5e958bbe5372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:59.325450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.401037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 154/303] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:59.401037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6304e4-4882-422f-b4bc-b5d624d07c3c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.401037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6304e4-4882-422f-b4bc-b5d624d07c3c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.401037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6304e4-4882-422f-b4bc-b5d624d07c3c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.401037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 155/304] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:57:59.402807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.403085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.403356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.409992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b9b1-28f4-4cfe-9d52-13c884e27c45 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.423393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:57:59.425007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:57:59.450217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.450978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.451193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.451466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.452225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:59.452531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:59.453938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:59.465069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 150/305] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:59.465069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.476233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.509954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 156/306] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:57:59.517230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.576853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.595142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f124-50a4-4e77-a071-e53e721f9250 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.624635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d4dcf-c251-4eb3-977f-5b87beee0100 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.632865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.633397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.633681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.633963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.644754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:59.653216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:59.654054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:59.654820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 151/307] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:59.655445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.667349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.668274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.668556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.668922 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] PATH_INFO: `/v3/users/14ea94ff5b434f28b39890ad5a0f5ed3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.683976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea94ff5b434f28b39890ad5a0f5ed3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:59.686031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:59.687693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 157/308] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/users/14ea94ff5b434f28b39890ad5a0f5ed3 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:59.693509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.736932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.761867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81a29c-f7c7-440d-8ca3-f4aea267cece None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.799167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.800162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.800448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.800726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.804343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380cd53-f248-486b-8a69-d9ba048b7df6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.811649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:57:59.820305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:57:59.821254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:57:59.822027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 152/309] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:57:59.822657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.836772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.842937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.843902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.844469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.844912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:59.845247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:59.846751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:57:59.855361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 158/310] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:57:59.855995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:57:59.942403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639c1d-503d-4bac-96e5-080320814b39 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.954659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:57:59.960667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e957c-d4b7-4250-8d91-c1b76e79fbf4 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:57:59.980157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:57:59.980825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:57:59.981133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:57:59.981408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:57:59.982264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] RBAC: Adding query filter params (role.id=5a0a716f6c914a16ab4b765a8faa97b0, user.id=14ea94ff5b434f28b39890ad5a0f5ed3, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:57:59.983066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:57:59.984520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.001154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 153/311] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/role_assignments?user.id=14ea94ff5b434f28b39890ad5a0f5ed3&scope.system=all&role.id=5a0a716f6c914a16ab4b765a8faa97b0 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:00.001154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:00.009326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007b600-aa50-4707-881f-20144287f420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.010209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007b600-aa50-4707-881f-20144287f420 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.010568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007b600-aa50-4707-881f-20144287f420 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.010913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007b600-aa50-4707-881f-20144287f420 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.011770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007b600-aa50-4707-881f-20144287f420 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:00.012149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007b600-aa50-4707-881f-20144287f420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.013739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007b600-aa50-4707-881f-20144287f420 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.024367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 159/312] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:00.030594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007b600-aa50-4707-881f-20144287f420 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:00.087589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:00.130941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4a67-f735-452c-a260-0c7850416248 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:00.170642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007b600-aa50-4707-881f-20144287f420 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:00.177813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.178885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.179258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.179622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] PATH_INFO: `/v3/users/85da03e7d89f40939cacf1ff30b0434d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.180955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] RBAC: Authorizing `identity:get_user(user_id=85da03e7d89f40939cacf1ff30b0434d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.182679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.185053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 154/313] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:57:59 2022] GET /identity/v3/users/85da03e7d89f40939cacf1ff30b0434d => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:00.191519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:00.226241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.227138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.227418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.227689 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] PATH_INFO: `/v3/users/6252729de2d746238a4a254c1e185a3a` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.229593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] RBAC: Authorizing `identity:get_user(user_id=6252729de2d746238a4a254c1e185a3a)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.231051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.232865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 160/314] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:58:00 2022] GET /identity/v3/users/6252729de2d746238a4a254c1e185a3a => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:00.238618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:00.267139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:00.344118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da133-ebdc-408f-a053-e4eb0e4d1653 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:00.353587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a45486-a513-4f5c-95b6-2a9144b828e1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:00.390049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.390722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.391085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.391277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.401304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:00.402667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.403553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.404123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.404123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] PATH_INFO: `/v3/system/users/6252729de2d746238a4a254c1e185a3a/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.405808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6252729de2d746238a4a254c1e185a3a, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.407200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.420675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 161/315] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jun 7 12:58:00 2022] PUT /identity/v3/system/users/6252729de2d746238a4a254c1e185a3a/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:00.490588 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.492605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.616069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 155/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:58:00.621962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:00.718409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:00.730794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a656-10ef-4551-9fe2-1695970f9d9e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:00.767408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7fca7-d140-4351-93dc-84cf913a3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.768655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7fca7-d140-4351-93dc-84cf913a3d99 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.769155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7fca7-d140-4351-93dc-84cf913a3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.769612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7fca7-d140-4351-93dc-84cf913a3d99 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.770998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7fca7-d140-4351-93dc-84cf913a3d99 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.772761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7fca7-d140-4351-93dc-84cf913a3d99 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.775036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 162/317] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:00 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:00.781219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:00.822758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:00.891472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6889-db19-4d92-b7ad-3842b6bae6f4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:00.927642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:00.928669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:00.929183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:00.929645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:00.930673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] RBAC: Adding query filter params (role.id=5a0a716f6c914a16ab4b765a8faa97b0, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71, user.id=85da03e7d89f40939cacf1ff30b0434d) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:00.931216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:00.932827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05337-f9b3-4ccc-b32e-2c1298ff1107 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:00.939875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 156/318] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:00 2022] GET /identity/v3/role_assignments?user.id=85da03e7d89f40939cacf1ff30b0434d&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=5a0a716f6c914a16ab4b765a8faa97b0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:01.500104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4727-5c19-4b34-b04a-5fd40fd8e978 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:01.500644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4727-5c19-4b34-b04a-5fd40fd8e978 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:01.500644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4727-5c19-4b34-b04a-5fd40fd8e978 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:01.502339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 163/319] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:01.507535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:01.507839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:01.508110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:01.525538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:01.526725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:01.601371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 157/320] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:01.623699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4727-5c19-4b34-b04a-5fd40fd8e978 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:01.731089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4727-5c19-4b34-b04a-5fd40fd8e978 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:01.764934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b548-21cf-4aea-bfcc-a89fb7738261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:01.765688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b548-21cf-4aea-bfcc-a89fb7738261 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:01.765976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b548-21cf-4aea-bfcc-a89fb7738261 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:01.766243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b548-21cf-4aea-bfcc-a89fb7738261 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:01.767627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b548-21cf-4aea-bfcc-a89fb7738261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:01.769123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b548-21cf-4aea-bfcc-a89fb7738261 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:01.770920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 164/321] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:01.776781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:01.808735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:01.880457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfaaf2-a146-4b2c-87e9-64d3f7936bc2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:01.917620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbcfa8-0437-4c66-a632-edb6772761cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:01.918297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcfa8-0437-4c66-a632-edb6772761cf None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:01.918574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcfa8-0437-4c66-a632-edb6772761cf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:01.918845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcfa8-0437-4c66-a632-edb6772761cf None admin] PATH_INFO: `/v3/groups` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:01.919559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbcfa8-0437-4c66-a632-edb6772761cf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:01.921041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbcfa8-0437-4c66-a632-edb6772761cf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:01.936176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 158/322] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jun 7 12:58:01 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:58:02.313332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68c67-dece-4bfa-9b4d-a40cd6196a9b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:02.313768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68c67-dece-4bfa-9b4d-a40cd6196a9b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:02.314115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68c67-dece-4bfa-9b4d-a40cd6196a9b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:02.315943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 165/323] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:02.322847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:02.323132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:02.323406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:02.344952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:02.346221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:02.426528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 159/324] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:02.449154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68c67-dece-4bfa-9b4d-a40cd6196a9b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:02.478885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:02.562421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68c67-dece-4bfa-9b4d-a40cd6196a9b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:02.613717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837020c5-6624-4836-97f0-cd8655e0f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:02.614718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837020c5-6624-4836-97f0-cd8655e0f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:02.615132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837020c5-6624-4836-97f0-cd8655e0f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:02.615535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837020c5-6624-4836-97f0-cd8655e0f4a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:02.628597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837020c5-6624-4836-97f0-cd8655e0f4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-837020c5-6624-4836-97f0-cd8655e0f4a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:02.636730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:02.637796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:58:02.638732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:02.641215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 166/325] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:02.647273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:02.684074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:02.772661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dcb58-9fdd-4c2e-82db-1515675d504b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:02.778527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580731-c9f8-4205-abb9-0cbee39ca304 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:02.778898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580731-c9f8-4205-abb9-0cbee39ca304 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:02.779276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580731-c9f8-4205-abb9-0cbee39ca304 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:02.780672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 167/326] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:02.786343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:02.786729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:02.786908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:02.809776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:02.811123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:02.813003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:02.814495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:02.814716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:02.814976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:02.815830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:02.816137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:02.817537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:02.826881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 160/327] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:02.832806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:02.900746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 168/328] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:02.933216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:02.943536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:02.963499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:02.964836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e126f-3b4f-49ed-a7ec-606dc1b181f6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:03.004529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:03.005630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:03.005913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:03.006184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] PATH_INFO: `/v3/users/14ea94ff5b434f28b39890ad5a0f5ed3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:03.007531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] RBAC: Authorizing `identity:get_user(user_id=14ea94ff5b434f28b39890ad5a0f5ed3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:03.009101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:03.011054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 161/329] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:58:02 2022] GET /identity/v3/users/14ea94ff5b434f28b39890ad5a0f5ed3 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:03.016715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:03.073544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2c0c-6b29-49f9-803c-0581368aa9ab None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:03.121255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:03.122456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:03.123468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:03.123963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:03.138420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:03.139481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bbfd-b2e6-4a4a-aa0e-9c9c02a4450c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:03.149092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:03.150028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:03.150884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:03.154097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 169/330] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:03.159924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:03.182999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:03.184020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:03.184300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:03.184573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] PATH_INFO: `/v3/system/users/14ea94ff5b434f28b39890ad5a0f5ed3/roles/5a0a716f6c914a16ab4b765a8faa97b0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:03.186243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=14ea94ff5b434f28b39890ad5a0f5ed3, role_id=5a0a716f6c914a16ab4b765a8faa97b0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:03.187713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:03.199303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 162/331] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jun 7 12:58:03 2022] PUT /identity/v3/system/users/14ea94ff5b434f28b39890ad5a0f5ed3/roles/5a0a716f6c914a16ab4b765a8faa97b0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 12:58:03.253226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:03.280248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c2d04-e4bf-4c87-927f-7a1575593384 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:03.318968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:03.320110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:03.320640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:03.321190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:03.322195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:03.322722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:03.324391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:03.335151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 170/332] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:03.341454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:03.375807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:03.484796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5695e-edfd-47d7-93b9-d45ee6f2b000 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:03.520833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2408152-bab8-4d2d-a83c-1ee97e55664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:03.521755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408152-bab8-4d2d-a83c-1ee97e55664b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:03.522031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408152-bab8-4d2d-a83c-1ee97e55664b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:03.522303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408152-bab8-4d2d-a83c-1ee97e55664b None admin] PATH_INFO: `/v3/users/6252729de2d746238a4a254c1e185a3a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:03.523875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2408152-bab8-4d2d-a83c-1ee97e55664b None admin] RBAC: Authorizing `identity:get_user(user_id=6252729de2d746238a4a254c1e185a3a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:03.525363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2408152-bab8-4d2d-a83c-1ee97e55664b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:03.527349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 163/333] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:58:03 2022] GET /identity/v3/users/6252729de2d746238a4a254c1e185a3a => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:03.533160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:03.682412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617101-80df-4b5b-bf85-55a8eaa31cf7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:03.730790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:03.731469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:03.731752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:03.732029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:03.732877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] RBAC: Adding query filter params (role.id=c5faf990280443b18b96e64a7fee2798, user.id=6252729de2d746238a4a254c1e185a3a, scope.system=all) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:03.733217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:03.734680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f5d5-2884-4a9f-8d59-cd01ca32e312 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:03.745108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:03.754633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 171/334] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jun 7 12:58:03 2022] GET /identity/v3/role_assignments?user.id=6252729de2d746238a4a254c1e185a3a&scope.system=all&role.id=c5faf990280443b18b96e64a7fee2798 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:04.918404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59aee-9e83-4de6-88b9-459375ce08dd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:04.918905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59aee-9e83-4de6-88b9-459375ce08dd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:04.918905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59aee-9e83-4de6-88b9-459375ce08dd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:04.920375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 164/335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:04.926449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b86a1-179d-433f-9332-324285419013 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:04.926918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b86a1-179d-433f-9332-324285419013 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:04.926994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b86a1-179d-433f-9332-324285419013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:04.944847 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f54b86a1-179d-433f-9332-324285419013 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:04.946066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f54b86a1-179d-433f-9332-324285419013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:05.025265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 172/336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:05.061324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59aee-9e83-4de6-88b9-459375ce08dd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.105647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078236f6-4ebf-448c-8be7-0bdbeaeb5eff None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.105993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078236f6-4ebf-448c-8be7-0bdbeaeb5eff None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.106216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078236f6-4ebf-448c-8be7-0bdbeaeb5eff None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.107782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 173/337] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:05.118755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.119063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.119314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.141219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:05.142440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:05.213273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:05.250570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59aee-9e83-4de6-88b9-459375ce08dd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:05.280494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 174/338] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:05.301424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:05.302298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.302579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.302854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.308003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.332792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:05.350489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:05.351423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:05.352192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:05.353296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 165/339] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:05.361990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.418248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:05.472552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a222b9-87c6-4a14-b70f-98a0d5577c31 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:05.523489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:05.524696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.524814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aeb3f-1a12-465f-b062-421d0ed9f625 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:05.525303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.525782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.546489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:05.560038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:05.560931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:05.562175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:05.564827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 175/340] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:05.570544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.573777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:05.574538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.574826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.575107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.576286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:05.576286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:05.577752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:05.592939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 166/341] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:05.600458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.633431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:05.693487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22773a-14a3-4870-8112-2eceb056aab7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:05.710912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:05.735964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:05.736606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.736885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.737185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.737946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:05.738257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:05.739983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:05.742477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96bcef-6db3-479d-9759-bb68327cae46 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:05.754773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 176/342] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:05.760312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.779748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:05.780416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.780701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.780982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.857734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:05.859262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:05.868716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:05.897587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c099b-2bfc-4d9b-b755-f1073a669feb None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:05.937676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:05.938450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:05.938729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:05.939007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:05.982142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 167/343] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:05.994729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:05.995500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:06.019142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.020655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.118479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bbaa-cd83-4076-8aa9-9c8f09c18a30 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.133239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:06.188357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 177/344] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:06.193154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.194160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:06.196846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.197160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.197439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.198715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.200193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.202238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 168/345] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:05 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:06.208137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:06.311464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:06.323122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f39a-b2d5-4db0-84a1-32aff7f5c3a3 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.334928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb875c3d-67c0-404b-8036-cf58c20dbe95 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.371555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.372450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.372723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.373001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.375778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.377786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.377979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.378292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.378577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.379271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.381460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 178/346] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:06 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:06.385156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.386887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.387015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:06.393500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 169/347] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:06 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:06.395828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:06.442441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:06.522218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1f0c-17a8-458a-9da5-b33fd73741af None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.570023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.570663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.570949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.571273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.572138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:06.572454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.576077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92a787-2b1c-4012-b2f0-3fc30d1ed1dd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.580814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 170/348] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:06 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=c5faf990280443b18b96e64a7fee2798 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:06.583127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3483437-81cd-4cf9-9812-2e020fd9f51a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.586525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d7a94-a0d9-4609-958e-c068121b6d02 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.586812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d7a94-a0d9-4609-958e-c068121b6d02 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.587095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d7a94-a0d9-4609-958e-c068121b6d02 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.588558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 171/349] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:06.597038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.597038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.597038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.623768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:06.625070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:06.657839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.659271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.659787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.660249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.661797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.663644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.666068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 179/350] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:06 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:06.672382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:06.714257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:06.717585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 172/351] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:06.762336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:06.822920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:06.911344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8e92-1f7c-49c6-9b20-fb64271a7157 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.935818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed0f7-b120-415d-9667-e50f63750e24 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:06.967085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.968393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.968868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.969308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:06.970394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:06.971517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:06.973189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:06.984419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 180/352] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:06 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=d0a91103ec054c63b098cc4abec5731f => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:06.986590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:06.987811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:06.988212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:06.988584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.002003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:07.010629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:07.012327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:07.014712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 173/353] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:07.019701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:07.133405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:07.162941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e0b2-f21f-4845-917e-1d5b5e6d0b39 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:07.209719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:07.210421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.210703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.210982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.211753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:07.212061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:07.213594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fd35-6134-49e2-b427-2bd7212cd7e9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:07.226039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 181/354] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:07.231723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:07.339821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:07.350510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65679ce7-9fc5-4ffd-81dd-fce13b19e09f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:07.354503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55bfc7-5489-49ad-ac9b-075f9da248b3 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.354788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55bfc7-5489-49ad-ac9b-075f9da248b3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.355068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55bfc7-5489-49ad-ac9b-075f9da248b3 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.356483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 182/355] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:07.362638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470104b-ed6a-4cb9-bf8d-d10f669ff74c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.362924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470104b-ed6a-4cb9-bf8d-d10f669ff74c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.363188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470104b-ed6a-4cb9-bf8d-d10f669ff74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.387806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8470104b-ed6a-4cb9-bf8d-d10f669ff74c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:07.390509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8470104b-ed6a-4cb9-bf8d-d10f669ff74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:07.450519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:07.451209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.451499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.451775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.542580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 183/356] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:07.565651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:07.567248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:07.568001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749516a-85b4-4d3f-936c-d3c5a64fc3d0 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.568521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749516a-85b4-4d3f-936c-d3c5a64fc3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.569000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749516a-85b4-4d3f-936c-d3c5a64fc3d0 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.570739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 184/357] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:07.576778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.577477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.577974 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.621032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:07.622506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:07.675214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:07.687273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 174/358] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:07.688353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:07.790706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:07.798962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 185/359] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:07.800153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:07.804320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40829a07-133c-43e9-80cf-a5f3f3668fb2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:07.848782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:07.849675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.849960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.850240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:07.878535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:07.886864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:07.887735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:07.888508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 175/360] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:07.898262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:07.956012 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de3a20-82b3-4d23-a813-59d7f08306e7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:07.998369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:07.999352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:07.999640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:07.999914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.001152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.002970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.004713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 186/361] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:07 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:08.005724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.015016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.084293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.095837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf8ef-c76f-499e-9a3d-44f6dd313e69 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.126405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942b469-717c-4e14-a80d-5845fbcace0b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.141569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.142851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.143131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.143403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.159530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:08.167569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:08.168525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:08.169352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 176/362] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:08.170038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.181372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.182484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.182970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.183433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.184436 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:08.184927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.186776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991499a-16bc-4a75-91f2-df26eee230e1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.197066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 187/363] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:08.198678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc21b-9f51-4cad-96d7-02b44bae4317 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.199168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc21b-9f51-4cad-96d7-02b44bae4317 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.199628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc21b-9f51-4cad-96d7-02b44bae4317 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.201052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 188/364] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:08.202019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fc21b-9f51-4cad-96d7-02b44bae4317 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.293662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c25a5-0f70-44aa-a2e6-8467d61340ed None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.313951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.331194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fc21b-9f51-4cad-96d7-02b44bae4317 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.341954 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.343834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.344714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.345229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.347245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.349986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.353356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 177/365] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:08.354529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.368093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.377666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.378641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.379123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.379550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.380519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:08.381005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.382726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4ed8-adb5-443e-b53d-f854fd1c2569 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.393716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 189/366] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:08.395465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.400871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.400871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.426667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:08.428191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:08.490326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af5e53-6171-4e7b-872f-baa7a569c5a1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.502378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 190/367] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:08.502551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.529169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.530387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.530950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.531413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.598945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.615759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382c5a-f7e1-4aee-b8be-74498369888d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.629522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.631545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.641759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.657908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.658842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.659208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.659485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.660354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:08.660668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.663572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.669692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 191/368] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=c5faf990280443b18b96e64a7fee2798 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:08.671570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.773911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 178/369] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:08.777080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.796344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677266e-ba75-4db7-b080-33ae8b967480 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.835697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.836938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.837452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.837999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] PATH_INFO: `/v3/users/14ea94ff5b434f28b39890ad5a0f5ed3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.839569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] RBAC: Authorizing `identity:get_user(user_id=14ea94ff5b434f28b39890ad5a0f5ed3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:08.841306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:08.843899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 192/370] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/users/14ea94ff5b434f28b39890ad5a0f5ed3 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:08.849406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.872445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.893328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862eeb9-bfe9-443a-b09b-89c5331a7b9c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:08.918932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:08.931161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:08.931988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:08.932265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:08.932535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:08.944594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:08.953564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:08.954522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:08.955501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 179/371] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:08.956152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:08.979245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d402-d48b-4075-8ba4-679e496b9e52 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.021800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.023914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.024386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.024870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.026452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.028316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.030776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 193/372] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:09.031783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:09.070206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04695d-445b-4afd-8294-8b81598f076c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.105513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.106036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.106289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.106563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.107527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] RBAC: Adding query filter params (role.id=5a0a716f6c914a16ab4b765a8faa97b0, user.id=14ea94ff5b434f28b39890ad5a0f5ed3, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:09.107723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.109213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.115638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:09.122355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 180/373] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jun 7 12:58:08 2022] GET /identity/v3/role_assignments?user.id=14ea94ff5b434f28b39890ad5a0f5ed3&scope.system=all&role.id=5a0a716f6c914a16ab4b765a8faa97b0 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:09.123311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:09.164913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971567d-ed45-4a57-a769-bf04fad917a1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.197092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:09.212848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.214107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.214577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.215211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.216151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:09.216643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.222725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.233389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 194/374] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:09.243063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e688fd-c4f3-448c-85af-9bf7451b5b02 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.244189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:09.288049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.288939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.289250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.289524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.292057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.293577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.295607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 181/375] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:09 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:09.301462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:09.381620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:09.424337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8aeb-9ab5-4e3f-b03f-d8eb4399c93f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.429868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d894f-d7c1-4ec1-8a04-2764da9ef4ae None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.466590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.467269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.467549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.467825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.468684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:09.468996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.471613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.479059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 182/376] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:09 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=d0a91103ec054c63b098cc4abec5731f => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:09.502522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.503205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.503500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.503786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.572694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:09.590681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.592161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.699922 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 195/377] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:09.705314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:09.828946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fc01-a5f3-4911-9a1e-7cfa077e46e0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:09.859666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:09.866418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:09.867750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:09.868429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:09.868705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] PATH_INFO: `/v3/projects/ebd193fab79b438b93f957ec4ee6cab4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:09.869928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] RBAC: Authorizing `identity:get_project(project_id=ebd193fab79b438b93f957ec4ee6cab4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:09.871392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:09.873503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 183/378] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:09 2022] GET /identity/v3/projects/ebd193fab79b438b93f957ec4ee6cab4 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:09.878766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:09.970329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:09.982622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee5c4-86ce-4ca6-884f-f4d1bd76811a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:10.018104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60296888-6864-49ff-be52-4f44339629fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:10.019185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60296888-6864-49ff-be52-4f44339629fb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.019466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60296888-6864-49ff-be52-4f44339629fb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.019734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60296888-6864-49ff-be52-4f44339629fb None admin] PATH_INFO: `/v3/groups/453a6fa26b8848d3a6a28d763a4e4169` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.026498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60296888-6864-49ff-be52-4f44339629fb None admin] RBAC: Authorizing `identity:get_group(group_id=453a6fa26b8848d3a6a28d763a4e4169)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:10.028026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60296888-6864-49ff-be52-4f44339629fb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:10.029798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 196/379] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:09 2022] GET /identity/v3/groups/453a6fa26b8848d3a6a28d763a4e4169 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:10.035885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:10.142970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207caa6-8562-41e0-9db4-79c5734fe49a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:10.179759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:10.180421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.180521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bb73-d26e-4baa-85dc-523614accda0 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.180695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.180810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bb73-d26e-4baa-85dc-523614accda0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.180955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.181063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bb73-d26e-4baa-85dc-523614accda0 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.181824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] RBAC: Adding query filter params (group.id=453a6fa26b8848d3a6a28d763a4e4169, role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=ebd193fab79b438b93f957ec4ee6cab4) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:10.182134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:10.183578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:10.183680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 197/380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:10.188600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52290-e61a-4dce-8e80-f73b1f6cac63 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.188893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52290-e61a-4dce-8e80-f73b1f6cac63 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.189283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52290-e61a-4dce-8e80-f73b1f6cac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.189801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 184/381] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:10 2022] GET /identity/v3/role_assignments?group.id=453a6fa26b8848d3a6a28d763a4e4169&scope.project.id=ebd193fab79b438b93f957ec4ee6cab4&role.id=62f04dcd631e4206baea551a55948cbb => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:10.222466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-05e52290-e61a-4dce-8e80-f73b1f6cac63 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:10.223640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-05e52290-e61a-4dce-8e80-f73b1f6cac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:10.342236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 198/382] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:10.386726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:10.473235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:10.515798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d949df7-f5a6-43f4-8e62-6881edcf7142 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:10.549100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c671-0849-4d4b-8ba5-da40e364d460 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.549415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c671-0849-4d4b-8ba5-da40e364d460 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.549654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c671-0849-4d4b-8ba5-da40e364d460 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.552823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 199/383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:10.554630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:10.555459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.555740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.556013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.559561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.559857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.560142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.568909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:10.577950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:10.578858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:10.579614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:10.580307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 185/384] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:10.587858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:10.591609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:10.592805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:10.719846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 200/385] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:10.747110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:10.757666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:10.759501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330b509-6b86-4e03-96e4-346450a640c2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:10.806252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:10.827887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:10.828924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.829421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.830105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.831140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:10.831683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:10.833306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:10.852797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e32eb-2b47-48dc-8822-16af9e4fed1b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:10.853206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 186/386] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:10.858505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:10.897745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:10.898932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:10.899205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:10.899478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:10.916702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:10.924856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:10.925774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:10.926569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:10.928272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 201/387] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:10.938060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:11.027193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:11.070651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7321ef-9d00-492d-9bc9-961e4d14469e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.074179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b56778-310c-4121-828d-1515369981f7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.136799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.137708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.137991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.138268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.139410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.140084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.140356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.140623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.141403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:11.141704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.143114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.145343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.146790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.148852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 187/388] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:10 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:11.155087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:11.160117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 202/389] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:11.166098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:11.257145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:11.288652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1132e94-19c7-41ad-b12d-bbe61d610c74 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.319774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:11.327758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.328928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.329423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.329932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.331576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.333228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.335460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 203/390] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:11 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:11.342195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:11.365647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8e0a-f41a-4f6a-b74c-5d50a071e6f9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.467100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.467512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.467796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.468070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.474805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.475758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.477244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 188/391] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:11 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:11.482851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:11.503379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3eea-71fd-4aa3-a554-8d27888aeb52 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.541882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.542996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.543415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.543820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.545471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.547213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.549725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 204/392] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:11 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:11.555459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:11.637626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:11.677653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ee05-45bf-4bad-934b-e0ca2e28218d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.716525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd983ed-a76e-415c-a0c0-f1115726e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.717873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd983ed-a76e-415c-a0c0-f1115726e69f None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.718289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd983ed-a76e-415c-a0c0-f1115726e69f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.718701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd983ed-a76e-415c-a0c0-f1115726e69f None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.721372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd983ed-a76e-415c-a0c0-f1115726e69f None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f1a8bc8a814143aeb23e059c53bffb, group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.723089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd983ed-a76e-415c-a0c0-f1115726e69f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.734735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c591-1308-4be2-a862-7a89f383cba0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:11.746059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 205/393] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jun 7 12:58:11 2022] PUT /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/d0a91103ec054c63b098cc4abec5731f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:11.772371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:11.792789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:11.793996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.794430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.794938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.797186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f1a8bc8a814143aeb23e059c53bffb, group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:11.799128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:11.828320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326823d-cceb-4de5-99a0-9ec241ad477b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.828870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326823d-cceb-4de5-99a0-9ec241ad477b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.829294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326823d-cceb-4de5-99a0-9ec241ad477b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.831167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 206/395] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:11.831315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 189/395] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jun 7 12:58:11 2022] PUT /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:11.838179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:11.838653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:11.839021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:11.860118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:11.861819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:11.946716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 207/396] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:11.972107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:12.107856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587cb06-5454-4c19-a5ac-41fa956a1eeb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:12.148267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:12.149147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:12.149432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:12.149707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:12.162114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:12.170143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:12.171120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:12.171903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 190/397] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:12.179245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:12.262253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:12.317358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b640e3-be42-45f3-854f-20ee422685f7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:12.355998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:12.356753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:12.357060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:12.357396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:12.358206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:12.358456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:12.360110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:12.370521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 208/398] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:12.376100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:12.455920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:12.537621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9f25-19e2-4947-98c4-1c197bfa9170 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:12.591369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6694b-5489-419e-861a-6610d8765e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:12.592259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6694b-5489-419e-861a-6610d8765e16 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:12.592540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6694b-5489-419e-861a-6610d8765e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:12.592818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6694b-5489-419e-861a-6610d8765e16 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:12.597762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6694b-5489-419e-861a-6610d8765e16 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:12.599232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6694b-5489-419e-861a-6610d8765e16 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:12.601366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 191/399] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:12 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:12.607052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:12.777707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96452c1-3ff4-4fde-b5fe-442d4849f4c6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:12.804112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:12.830256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:12.831716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:12.832058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:12.832339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:12.837787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:12.839472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:12.841053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ee94-4809-4055-8429-d08026559822 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:12.841364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ee94-4809-4055-8429-d08026559822 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:12.841459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 209/400] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:12 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:12.841699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ee94-4809-4055-8429-d08026559822 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:12.843192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 192/401] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:12.848716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:12.867662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:12.867948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:12.868151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:12.904367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:12.905618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:13.025061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e4630-264b-483d-bb30-62fc25ce4de2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:13.036077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 193/402] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:13.063545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:13.078381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:13.079299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.079580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.079995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.084671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] RBAC: Authorizing `identity:create_grant(project_id=b99d47b4a88c4a968eeb402c6a7c1a71, group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:13.087775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:13.119341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 210/403] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jun 7 12:58:12 2022] PUT /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:13.127995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:13.215746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f2cd-0096-4995-bfd5-6577386d9700 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:13.265190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e361-7434-4ef4-8345-ab98471d1720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:13.266040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e361-7434-4ef4-8345-ab98471d1720 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.266326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e361-7434-4ef4-8345-ab98471d1720 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.266594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e361-7434-4ef4-8345-ab98471d1720 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.280110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4e361-7434-4ef4-8345-ab98471d1720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3dc4e361-7434-4ef4-8345-ab98471d1720 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:13.288979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:13.290039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:13.290826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 194/404] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:13.298692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:13.385853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:13.403388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d0798-06a2-4fa1-a51e-814f56d25a57 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.404001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d0798-06a2-4fa1-a51e-814f56d25a57 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.404467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d0798-06a2-4fa1-a51e-814f56d25a57 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.407196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 195/405] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:13.412652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.412939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.413251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.454326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:13.455618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:13.460068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091215-cc8a-415a-ad8e-51951519651a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:13.498411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:13.499520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.499975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.500427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.501541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:13.502125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:13.503919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:13.513267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 211/406] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:13.520017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:13.559921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 196/407] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:13.601152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:13.653495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:13.718800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf9dde-221b-4a27-966b-fbaaac3e81ca None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:13.734533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:13.783457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885575d9-f5ce-4d6f-bc7c-e01aa111c6bc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:13.786478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:13.787356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.787634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.787905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.789751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:13.791218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:13.801366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 212/408] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:13 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:13.803080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:13.855346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:13.856161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:13.856437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:13.856707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:13.877659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:13.885310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:13.886171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:13.886935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 197/409] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:13.897291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:13.981107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac332e2-b5b0-419b-963a-bae9e972ec4c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:14.041381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:14.042255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.042534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.042801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.044644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:14.046102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:14.054509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 213/410] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:13 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:14.056477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:14.061392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:14.085295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55401376-6d71-4c19-b229-f52a79bbb137 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:14.135675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:14.148737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:14.149449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.149726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.149994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.150760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:14.151065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:14.152437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:14.167006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 198/411] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:14.174597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:14.239317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da282-2bd6-4aa1-ba64-cdde11ae7d2f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:14.305168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:14.305950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.306220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.306488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.310392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99d47b4a88c4a968eeb402c6a7c1a71, group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:14.311843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:14.334653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 214/412] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jun 7 12:58:14 2022] PUT /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67/roles/d0a91103ec054c63b098cc4abec5731f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:14.362043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49079bc1-24d9-49a8-8f4a-0a91f5eef8a7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:14.438612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:14.439563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.439845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.440150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] PATH_INFO: `/v3/groups/453a6fa26b8848d3a6a28d763a4e4169` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.441636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] RBAC: Authorizing `identity:get_group(group_id=453a6fa26b8848d3a6a28d763a4e4169)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:14.443133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:14.445924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 199/413] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:14 2022] GET /identity/v3/groups/453a6fa26b8848d3a6a28d763a4e4169 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:14.450399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:14.627482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ef69-fa05-43b0-93f2-607a27bc5b04 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:14.634352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:14.680506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1f426-057a-4d18-8fc8-190b8addf606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:14.681813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f426-057a-4d18-8fc8-190b8addf606 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.682365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f426-057a-4d18-8fc8-190b8addf606 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.682827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f426-057a-4d18-8fc8-190b8addf606 None admin] PATH_INFO: `/v3/projects/ebd193fab79b438b93f957ec4ee6cab4` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.684293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1f426-057a-4d18-8fc8-190b8addf606 None admin] RBAC: Authorizing `identity:get_project(project_id=ebd193fab79b438b93f957ec4ee6cab4)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:14.685986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1f426-057a-4d18-8fc8-190b8addf606 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:14.688259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 215/414] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:14 2022] GET /identity/v3/projects/ebd193fab79b438b93f957ec4ee6cab4 => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:14.693985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:14.696411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188e93c-5976-44b5-97bd-f034bb3de015 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.696922 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188e93c-5976-44b5-97bd-f034bb3de015 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.697685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188e93c-5976-44b5-97bd-f034bb3de015 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.700481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 216/415] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:14.710561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.711141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.711975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.720315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:14.737234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:14.739876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:14.814335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad57765-dc89-4fa1-9456-94cbbf6240be None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:14.848731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:14.849719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:14.850045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:14.850328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] PATH_INFO: `/v3/projects/ebd193fab79b438b93f957ec4ee6cab4/groups/453a6fa26b8848d3a6a28d763a4e4169/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:14.852313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebd193fab79b438b93f957ec4ee6cab4, group_id=453a6fa26b8848d3a6a28d763a4e4169, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:14.853812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:14.858753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 217/416] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:14.887713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 200/417] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jun 7 12:58:14 2022] PUT /identity/v3/projects/ebd193fab79b438b93f957ec4ee6cab4/groups/453a6fa26b8848d3a6a28d763a4e4169/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:14.890399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:15.037316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258523-04ec-436b-8fa8-7217b34fca93 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:15.039123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:15.087724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b41635-39e1-4cb3-adbf-87b8e3505e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:15.088587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41635-39e1-4cb3-adbf-87b8e3505e27 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.088846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41635-39e1-4cb3-adbf-87b8e3505e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.089152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41635-39e1-4cb3-adbf-87b8e3505e27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.110057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b41635-39e1-4cb3-adbf-87b8e3505e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-48b41635-39e1-4cb3-adbf-87b8e3505e27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:15.122642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:15.123580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:15.124358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:15.127842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 218/418] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:15.134048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:15.177416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7571c-6bd0-4bcd-bd4b-564f341658ba None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.177602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7571c-6bd0-4bcd-bd4b-564f341658ba None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.177923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7571c-6bd0-4bcd-bd4b-564f341658ba None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.179706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 219/419] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:15.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.185044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.185319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.203637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:15.204870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:15.246025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:15.274652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447ba85-3ad4-4b87-8efe-72e6dddfd819 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:15.313948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:15.315543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.316015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.316667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.318117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:15.318706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:15.320269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:15.331302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 201/420] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:15.336570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:15.343627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 220/421] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:15.391885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:15.461319 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490b359-5d3f-4b8c-9abe-089fbc983a04 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:15.509867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:15.510536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.510814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.511084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.536723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:15.589478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:15.606541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2192-a3fb-4502-a878-ba93e2135d74 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:15.635458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:15.636983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:15.721863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:15.722611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.722890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.723167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.740437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 202/422] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:15.748821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:15.765633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:15.773869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:15.774736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:15.775530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:15.781525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 221/423] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:15.790114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:15.793990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:15.853719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c068-d290-4cf8-b704-534a1f94c1b7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:15.890421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:15.891348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:15.891870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:15.892313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:15.893705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:15.897504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:15.899831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 203/424] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:15 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:15.905766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.021631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa958f-0b8b-4453-97c3-d247021fbc80 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.022072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b1ea6-f7d3-43ff-85b7-ea3503311012 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.033369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.067499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0051a-afd0-4e8b-aecc-531de1c6dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.068502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0051a-afd0-4e8b-aecc-531de1c6dd55 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.068781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0051a-afd0-4e8b-aecc-531de1c6dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.069073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0051a-afd0-4e8b-aecc-531de1c6dd55 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.070259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0051a-afd0-4e8b-aecc-531de1c6dd55 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.071713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0051a-afd0-4e8b-aecc-531de1c6dd55 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.073681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 204/425] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:15 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:16.081664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324a1a-d2bc-4285-b5f4-ddd8e187737c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.082202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324a1a-d2bc-4285-b5f4-ddd8e187737c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.082661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324a1a-d2bc-4285-b5f4-ddd8e187737c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.084468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 205/426] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:16.085694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324a1a-d2bc-4285-b5f4-ddd8e187737c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.099198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.100178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.100646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.100985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.101952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] RBAC: Adding query filter params (name=member) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:16.102431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.103970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a42190-30da-4467-ab00-ca99e9ede630 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.112768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 222/427] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:16.114355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.114840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.115328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.136495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:16.137987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:16.150927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.212249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324a1a-d2bc-4285-b5f4-ddd8e187737c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.228399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 223/428] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:16.235531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.267339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.268393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.268929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.269466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.270507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:16.271016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.272782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.285264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 206/429] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=d0a91103ec054c63b098cc4abec5731f => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:16.285264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.367289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.421064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92416-90fb-492e-aa85-8cf1134d79e5 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.451340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e913-8306-49a9-93e1-b2e142040855 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.493510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.495166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.495645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.496110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.510429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:16.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:16.520473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 12:58:16.521306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:16.523635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.524263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.524541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.524818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.525189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 207/430] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:16.531610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.567289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.648559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.651728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5340d0-b829-4037-89db-cc7fb3d01e20 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.672311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.674604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.689039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.689945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.690053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.690332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.691926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:16.691926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.692886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.702235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 208/431] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:16.708908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.793109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 224/432] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:16.803493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:16.820577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f62f3-fd9f-4511-aed7-2329d7da0f66 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.861725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.863184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c95cb8-43ae-467c-b976-d2eeee2a7945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.863867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95cb8-43ae-467c-b976-d2eeee2a7945 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.864153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95cb8-43ae-467c-b976-d2eeee2a7945 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.864432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95cb8-43ae-467c-b976-d2eeee2a7945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.897047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:16.933230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2778-990e-4979-9c7d-18542a46e3a1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:16.937649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c95cb8-43ae-467c-b976-d2eeee2a7945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.939139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c95cb8-43ae-467c-b976-d2eeee2a7945 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.970843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3475d0-1fbe-4187-8818-94296c76c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:16.971767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3475d0-1fbe-4187-8818-94296c76c481 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.971997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3475d0-1fbe-4187-8818-94296c76c481 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.972269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3475d0-1fbe-4187-8818-94296c76c481 None admin] PATH_INFO: `/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.973501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3475d0-1fbe-4187-8818-94296c76c481 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f1a8bc8a814143aeb23e059c53bffb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:16.975220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3475d0-1fbe-4187-8818-94296c76c481 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:16.981478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 225/433] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/projects/d5f1a8bc8a814143aeb23e059c53bffb => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:16.983636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ecee-410b-4f2e-a572-2df4eb0810ef None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:16.983932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ecee-410b-4f2e-a572-2df4eb0810ef None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:16.984211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ecee-410b-4f2e-a572-2df4eb0810ef None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:16.985729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 226/434] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:16.990423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0ecee-410b-4f2e-a572-2df4eb0810ef None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.053610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 209/435] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:58:17.059100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.059388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.059671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.076099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:17.077255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:17.110144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0ecee-410b-4f2e-a572-2df4eb0810ef None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.124722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:17.142117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:17.151698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.152581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.152867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.153196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.154102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 210/436] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:17.154735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.157585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:17.160398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:17.162511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 227/437] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:16 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:17.168583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.264964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c81cf6-f790-48c4-a23e-9284686ad2f1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.275985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0023d5-3b96-47bf-a948-9aa353b67ce4 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.302073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.302981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.303263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.303538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.304958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:17.306423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:17.308261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 211/438] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:17.309248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.315124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.316179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.316655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.317210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.318282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:17.318907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:17.321318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:17.329865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 228/439] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=d5f1a8bc8a814143aeb23e059c53bffb&role.id=c5faf990280443b18b96e64a7fee2798 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:17.331411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.386980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:17.388924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:17.444207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0665000-74a8-4ad5-9d08-df778e6fba90 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.474079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88974dc-892e-44bb-949e-c24db6039233 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.484627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.485988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.486689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.487157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.503442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:17.515475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:17.516601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:17.518618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 212/440] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:17.523196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.525519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.526422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.526700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.527038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.528691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:17.531285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:17.533271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 229/441] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:17.539249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.654030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd86d-65b7-489a-87d8-c51c0b204d5e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.679106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48a84e-560d-4e60-8751-f5faaafa40b6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.683158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:17.694212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:17.699915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652f301-b624-4297-b971-195b38703f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.700594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f301-b624-4297-b971-195b38703f1a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.700872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f301-b624-4297-b971-195b38703f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.701229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f301-b624-4297-b971-195b38703f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.702070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652f301-b624-4297-b971-195b38703f1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:17.702375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652f301-b624-4297-b971-195b38703f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:17.703770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652f301-b624-4297-b971-195b38703f1a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:17.714800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 213/442] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:17.715893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de40b4-087a-49ae-b118-9cc6f582d898 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.716185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de40b4-087a-49ae-b118-9cc6f582d898 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.716443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de40b4-087a-49ae-b118-9cc6f582d898 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.718069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 214/443] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:17.718324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.719281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.719281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.719536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.720348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=c5faf990280443b18b96e64a7fee2798, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:17.720911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:17.721994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de40b4-087a-49ae-b118-9cc6f582d898 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.723229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232c00-f55e-4727-a80e-549ec469d57a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:17.731263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 230/444] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=c5faf990280443b18b96e64a7fee2798 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:17.733466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.733946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.734399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.757777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:17.759360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:17.855055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de40b4-087a-49ae-b118-9cc6f582d898 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:17.855533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 231/445] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:17.883795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:17.905704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:17.906995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:17.907275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:17.907744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:17.979831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.004090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.005693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.014768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2f8ff-1ea5-4e57-a880-8de9a13e5eae None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.024565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.054873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.055691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.055963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.056240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.071650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:18.081047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:18.081977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:18.082736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 232/446] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:18.091357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 215/447] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:18.127074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.212761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656644b-3ca1-4ecf-8368-44ef1b7ad603 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.223473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.243771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fccdf0-d26d-4b5f-a190-051e0e945d62 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.246183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.246862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.247143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.247418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.248167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:18.248476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.249884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.257957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 233/448] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:18.263398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.279404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.280269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.280551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.280796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] PATH_INFO: `/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.282003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] RBAC: Authorizing `identity:get_project(project_id=b99d47b4a88c4a968eeb402c6a7c1a71)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.283475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.285219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 216/449] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/projects/b99d47b4a88c4a968eeb402c6a7c1a71 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:18.290450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.292248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.364529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4cca-12ce-4c80-ad13-556b7225af59 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.406778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.407654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.407880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.408217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.410661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c218e3-6849-4d92-bbd2-1fe27d31591a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.456973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.457888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.458160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.458433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] PATH_INFO: `/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.459632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] RBAC: Authorizing `identity:get_group(group_id=3758ef82e4cd4d7ba9af8f84bcc8fa67)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.461122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.462752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 217/450] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/groups/3758ef82e4cd4d7ba9af8f84bcc8fa67 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:18.468550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.492148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.497186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.498659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.526294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.578318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c442ad4-b201-4fb1-a4f6-45c84da617b5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.609995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 234/451] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:58:18.610940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.621597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.622273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.622666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.622944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.623800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] RBAC: Adding query filter params (group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67, role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:18.624112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.625974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.632163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 218/452] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/role_assignments?group.id=3758ef82e4cd4d7ba9af8f84bcc8fa67&scope.project.id=b99d47b4a88c4a968eeb402c6a7c1a71&role.id=d0a91103ec054c63b098cc4abec5731f => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:18.723399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36052f8-a5c1-45b4-869a-4194a3d1f84b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.753446 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.762095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.762983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.763260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.763530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] PATH_INFO: `/v3/projects/ebd193fab79b438b93f957ec4ee6cab4` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.764732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] RBAC: Authorizing `identity:get_project(project_id=ebd193fab79b438b93f957ec4ee6cab4)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.766264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.768480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 235/453] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/projects/ebd193fab79b438b93f957ec4ee6cab4 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:18.774578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:18.865174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:18.885809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ec97-5f61-4a9e-a817-9e8520cc9c84 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:18.920901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d73ea-ec24-4c13-be80-812dd4cd6ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:18.921803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d73ea-ec24-4c13-be80-812dd4cd6ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:18.922083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d73ea-ec24-4c13-be80-812dd4cd6ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:18.922354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d73ea-ec24-4c13-be80-812dd4cd6ba9 None admin] PATH_INFO: `/v3/groups/453a6fa26b8848d3a6a28d763a4e4169` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:18.923625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d73ea-ec24-4c13-be80-812dd4cd6ba9 None admin] RBAC: Authorizing `identity:get_group(group_id=453a6fa26b8848d3a6a28d763a4e4169)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:18.925157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d73ea-ec24-4c13-be80-812dd4cd6ba9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:18.926799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 219/454] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/groups/453a6fa26b8848d3a6a28d763a4e4169 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:18.933032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:19.033975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc613100-59f4-4129-8789-df3d5884913a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:19.066679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:19.067325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:19.067606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:19.067875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:19.068712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] RBAC: Adding query filter params (group.id=453a6fa26b8848d3a6a28d763a4e4169, role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=ebd193fab79b438b93f957ec4ee6cab4) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:19.069035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:19.070482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365d90e-3cd5-4336-b2fb-3d8cb542231d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:19.076288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 236/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jun 7 12:58:18 2022] GET /identity/v3/role_assignments?group.id=453a6fa26b8848d3a6a28d763a4e4169&scope.project.id=ebd193fab79b438b93f957ec4ee6cab4&role.id=62f04dcd631e4206baea551a55948cbb => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:21.743728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190ca5-4b52-4934-a912-bbbe0c44425f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:21.744880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190ca5-4b52-4934-a912-bbbe0c44425f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:21.745394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190ca5-4b52-4934-a912-bbbe0c44425f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:21.747314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 220/456] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:21.753212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1683-43b0-46e5-8c96-4930bf806fe5 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:21.754182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1683-43b0-46e5-8c96-4930bf806fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:21.754676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1683-43b0-46e5-8c96-4930bf806fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:21.776707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ec0c1683-43b0-46e5-8c96-4930bf806fe5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:21.778274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ec0c1683-43b0-46e5-8c96-4930bf806fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:21.855710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:21.867475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 237/457] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:21.914513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190ca5-4b52-4934-a912-bbbe0c44425f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.045878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190ca5-4b52-4934-a912-bbbe0c44425f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:22.091597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a2fd-fcd9-407e-8c9f-7e10c959a280 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.091978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a2fd-fcd9-407e-8c9f-7e10c959a280 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.092335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a2fd-fcd9-407e-8c9f-7e10c959a280 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.093908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 238/458] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:22.099874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06f5da-d2a3-4506-bb40-ffde47debf8c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.100168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06f5da-d2a3-4506-bb40-ffde47debf8c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.100442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06f5da-d2a3-4506-bb40-ffde47debf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.108592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:22.109449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.109728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.110002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.121555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:22.122944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:22.127505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3d06f5da-d2a3-4506-bb40-ffde47debf8c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:22.129083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3d06f5da-d2a3-4506-bb40-ffde47debf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e7bd0711-c5b8-480f-b40e-bddb4304a4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:22.146537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:22.147453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:22.148660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:22.148660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:22.148660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:22.148660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:22.152964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 221/459] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:22.154730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918361c-6e21-41e1-b3d6-ccf52d723675 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.154843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918361c-6e21-41e1-b3d6-ccf52d723675 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.155108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918361c-6e21-41e1-b3d6-ccf52d723675 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.156442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 222/460] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:22.157612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918361c-6e21-41e1-b3d6-ccf52d723675 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.163090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:22.207325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 239/461] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:22.213656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.214179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.214655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.246184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:22.247856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:22.271603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918361c-6e21-41e1-b3d6-ccf52d723675 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:22.308956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:22.309970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.310506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.311109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.312125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:22.312577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:22.314303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:22.333163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 223/462] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:22.334031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.337105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 240/463] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:22.338338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.398918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:22.401765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:22.445261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2244814-418a-48c8-bd05-b5eb78857974 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:22.469456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aba3b-032c-4537-a747-c098c364aef4 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:22.487347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:22.488350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.488713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.489059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.503142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:22.505062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:22.516581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:22.517821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.518561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.518943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.519782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:22.521379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:22.527809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:22.528683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:22.529716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:22.529716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:22.529716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:22.529716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:22.530432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 224/464] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:22.533120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.553178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 241/465] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:58:22 2022] POST /identity/v3/users => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:58:22.554273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.736919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0622-2eca-430c-a4f6-90df48d1f229 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:22.753146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689589d-f3b0-42c2-97ab-5304fc36658c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:22.753358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:22.762039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:22.786898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:22.788220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.788569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.788929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.799167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:22.800380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.800380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.800551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.801356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:22.801671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:22.803133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:22.806290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:22.808166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e17f68a9-1a8d-4606-ad91-be0925d580dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:22.829281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:22.830568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:22.831438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:22.831438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:22.831438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:22.831438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:22.831438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 225/466] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:22.835710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47201b-18c8-467a-a923-683479166090 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.835710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47201b-18c8-467a-a923-683479166090 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.835710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47201b-18c8-467a-a923-683479166090 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.836032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 226/467] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:22.842142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:22.842509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:22.842907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:22.863850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:22.865538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:22.946020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 227/468] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:22.947190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:22.970560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 242/469] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:22.976472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.080589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1812-7214-4c6e-940c-e8274d3ff026 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.088401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcede6-4e6b-46e5-b1c4-087df1f724ef None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.090437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:23.119476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.120648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.121162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.121630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.122660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.124365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.130740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.131419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.131695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.131973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.132710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:23.133030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.135041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.153062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 228/470] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:23.153062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.157249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 243/471] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:58:22 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:58:23.158606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.188949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:23.291618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae228-d483-4d66-b1a5-e862846845bd None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.296129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32455804-f0da-4d20-8b99-c606d97c59fc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.329813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5bc62-f49e-48c4-9a2b-5b8588642a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.330539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bc62-f49e-48c4-9a2b-5b8588642a5a None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.330875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bc62-f49e-48c4-9a2b-5b8588642a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.331091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bc62-f49e-48c4-9a2b-5b8588642a5a None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.331825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5bc62-f49e-48c4-9a2b-5b8588642a5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.333343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5bc62-f49e-48c4-9a2b-5b8588642a5a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.344143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.345578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.346024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.346539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.361723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 244/472] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:58:23 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:58:23.363220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e29b-6ebe-4019-a5d4-0b9b147972a9 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.363513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e29b-6ebe-4019-a5d4-0b9b147972a9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.363829 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e29b-6ebe-4019-a5d4-0b9b147972a9 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.366126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 245/473] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:23.369502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.371108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.374059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.374418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.374694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:23.406459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:23.407364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:23.409095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:23.409095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:23.409095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:23.409095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:23.409095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 229/474] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:23.415865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:23.417298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:23.419091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.485429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:23.499875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 246/475] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:23.525163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.537240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:23.557930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419454c-c131-4152-a4f2-51985d4ded84 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.597936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.599004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.599415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.599882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.600786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:23.601263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.602977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.620705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 230/476] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:23.626753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.661835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c40a6-e205-4e85-a7aa-51c237f974d2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.697934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:23.701113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.702885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.703343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.703959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.704936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.706684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.714000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.sql.core [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 12:58:23.714000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 12:58:23.714000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [parameters: {'id': '046223476bc94beaa467c3e469a75482', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 12:58:23.714000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application conn.query(q) Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result.read() Jun 07 12:58:23.732852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return ref.to_dict() Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 12:58:23.733763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application next(self.gen) Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application yield resource Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application next(self.gen) Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise self.value Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application session.commit() Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 12:58:23.734634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.session.flush() Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application compat.raise_( Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 12:58:23.735481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 12:58:23.736711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application conn.query(q) Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result.read() Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 12:58:23.737787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [parameters: {'id': '046223476bc94beaa467c3e469a75482', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:23.739099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 12:58:23.740787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:23.742480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb4408-579e-42cf-9726-6c3fa4400bd0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.744397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 247/477] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jun 7 12:58:23 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:23.749885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:23.788635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.789635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.790142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.790426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.791361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:23.793720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:23.830262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 231/478] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:58:23 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:58:23.835103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:23.869799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4f9a-dbb0-4349-bd84-cc54bac3a9af None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:23.910101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d637fbf-fa64-4d4a-9cfc-6b1abcffdba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:23.911292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637fbf-fa64-4d4a-9cfc-6b1abcffdba3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:23.911752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637fbf-fa64-4d4a-9cfc-6b1abcffdba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:23.912196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637fbf-fa64-4d4a-9cfc-6b1abcffdba3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:23.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d637fbf-fa64-4d4a-9cfc-6b1abcffdba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1d637fbf-fa64-4d4a-9cfc-6b1abcffdba3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:23.933887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:23.934822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 12:58:23.935590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:23.937997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 248/479] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:58:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:23.943825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:24.071282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2b8c-3b4c-43e0-9795-254a76380c44 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:24.096582 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:24.109729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:24.110677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:24.111172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:24.111901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:24.112865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:24.113339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:24.114860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fde5-0065-4497-b5c5-5d1396ba10e8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:24.125221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 232/480] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:25.103820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efe1b4-d132-4ebd-a428-25de9ca39038 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:25.104402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efe1b4-d132-4ebd-a428-25de9ca39038 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:25.104402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efe1b4-d132-4ebd-a428-25de9ca39038 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:25.105946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 249/481] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:25.111777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:25.112226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:25.112472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:25.137245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:25.138447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:25.232196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 233/482] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:25.255933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efe1b4-d132-4ebd-a428-25de9ca39038 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:25.394281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efe1b4-d132-4ebd-a428-25de9ca39038 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:25.434459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:25.440235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:25.445968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:25.446254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:25.446537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:25.462216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:25.470628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:25.471569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:25.472342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 250/483] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:25.478095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:25.652758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea349b3-2942-47ae-82d5-fcdf524ac604 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:25.672901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:25.692299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:25.692979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:25.693286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:25.693562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:25.694325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:25.694617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:25.695986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:25.708020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 234/484] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:25.713895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:25.891037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05570ac-7db0-4bc8-9fde-6e80a8542a68 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:25.939230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:25.940257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:25.940574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:25.940853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:25.952488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:25.954000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-9e4b53e6-6938-41db-a5b7-35c1409d0f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:25.980220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:25.981116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:25.981949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:25.981949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:25.981949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:25.981949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:25.985123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 251/485] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:25.987326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.038575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266cfcd-2c36-4c93-9023-948135ff34f8 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.038896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266cfcd-2c36-4c93-9023-948135ff34f8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.039124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266cfcd-2c36-4c93-9023-948135ff34f8 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.040631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 252/486] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:26.057097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.057422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.057664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.094476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:26.095842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:26.117195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9070d-b7a6-4a4f-a2d5-136c1e78dca7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:26.174107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:26.182125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:26.182829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.183113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.183389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.184143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:26.184452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:26.185898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:26.204343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 253/487] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:26.212957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 235/488] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:26.217695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.233131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.308052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:26.394634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47793-83e2-449e-bcd4-583e2ab961d9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:26.395196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb87b5-fb4a-4f1c-a9ea-83ed1a5359da None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:26.459284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30f9af-a159-429b-92af-9e496fe79924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:26.460316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:26.461456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30f9af-a159-429b-92af-9e496fe79924 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.462492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.462986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30f9af-a159-429b-92af-9e496fe79924 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.463475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.463934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30f9af-a159-429b-92af-9e496fe79924 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.464392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.478278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:26.481127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:26.488313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30f9af-a159-429b-92af-9e496fe79924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fe30f9af-a159-429b-92af-9e496fe79924 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:26.501987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:26.502886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:26.503664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:26.507686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 236/489] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:26.509625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03f59-0363-4e04-a57f-f81589badedd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.509917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03f59-0363-4e04-a57f-f81589badedd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.510198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03f59-0363-4e04-a57f-f81589badedd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.511462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 237/490] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-e3ce36bb-0884-4124-b9af-a3ce47b124ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:26.515728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:26.516606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:26.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:26.518951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a03f59-0363-4e04-a57f-f81589badedd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.519022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 254/491] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:26.519234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.519486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.519761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.543950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:26.545465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:26.583910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:26.634940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 255/492] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:26.636386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.668037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:26.673162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a03f59-0363-4e04-a57f-f81589badedd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:26.716489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:26.717743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.718166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.718580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.719956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:26.720589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:26.722826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:26.738829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 238/493] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:26.739959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.769214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ed34-4398-4eb5-bb86-7b4705d1b783 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:26.806748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:26.807706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.808246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.808523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.809396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:26.809704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:26.811259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:26.858034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 256/494] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:26.858915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.860957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543c884-2405-42fa-a743-ad13fe0fcbb0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:26.886620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:26.902342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0c3cb-ed1a-4555-a828-44eb3a5ad15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:26.903155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c3cb-ed1a-4555-a828-44eb3a5ad15d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.903432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c3cb-ed1a-4555-a828-44eb3a5ad15d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.903700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c3cb-ed1a-4555-a828-44eb3a5ad15d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.914578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0c3cb-ed1a-4555-a828-44eb3a5ad15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-86a0c3cb-ed1a-4555-a828-44eb3a5ad15d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:26.922284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:26.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:26.923967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 239/495] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:26.924976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69bee-c366-49e3-b8a9-7d5afecce8a3 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:26.925350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69bee-c366-49e3-b8a9-7d5afecce8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:26.925626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69bee-c366-49e3-b8a9-7d5afecce8a3 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:26.927041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 240/496] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:26.927610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69bee-c366-49e3-b8a9-7d5afecce8a3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:26.951953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:26.979913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6d8b-2f28-4616-857b-03b6f334bce4 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.015000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.015813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.016096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.016364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.027987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.029495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-3b838b7d-7f56-411a-8061-e1a619d3a3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:27.047211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:27.048075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:27.049219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:27.049219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:27.049219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:27.049219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:27.049219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 257/497] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:27.050321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.050321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.050440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.057484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69bee-c366-49e3-b8a9-7d5afecce8a3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.066844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:27.068022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:27.095999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.096658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.096936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.097234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.137766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 258/498] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:27.138465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.142537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.175778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.177587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.198559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.250835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f9812-bd64-4897-b949-0bb234e01c85 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.275407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 241/499] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:27.276248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.284011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.284748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.285061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.285367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.286124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:27.286429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.287846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.296170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 259/500] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:27.296948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.363658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.378659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b3f2-e067-4bfc-80dd-eb2949cf389e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.398958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3032228-b3dc-4f68-958b-4c482f2209a0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.399107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.412905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.413587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.413905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.414175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.414900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:27.415200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.416564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08829-c757-4258-a92f-e1d95b8e5edb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.428012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 242/501] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:27.429263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d651-aec6-4380-96d7-a93c3652a881 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.429545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d651-aec6-4380-96d7-a93c3652a881 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.429813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d651-aec6-4380-96d7-a93c3652a881 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.431019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 243/502] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:27.431701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d651-aec6-4380-96d7-a93c3652a881 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.438727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.439770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.440049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.440314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.451296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:27.459150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:27.460114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:27.460999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 260/503] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:27.461683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.538114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d651-aec6-4380-96d7-a93c3652a881 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.560576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67593-f12a-44c8-abad-ed9182bb7ade None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.571978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.572783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.573102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.573368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.584653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.585807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.586117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.595324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.596485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.596764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.597047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:27.603901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:27.604725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:27.608664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:27.608664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:27.608664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:27.608664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:27.608664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 244/504] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:27.608664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.612308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.613869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-579e6690-d918-4e21-b2cb-e8152a50500d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:27.631870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:27.632857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:27.634040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:27.634040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:27.634040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:27.634040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:27.634040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 261/505] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:27.634483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.634560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.634840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.645342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.652032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:27.653259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:27.714488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2dfa-a7a4-42c1-9383-77a57effe909 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.720151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 262/506] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:27.721052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.757640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.758565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.758914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.759198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.767492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.768962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:27.784787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:27.785719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:27.786867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 245/507] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:27.787679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.819895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd90eea-9c06-40b1-afb8-7cd29fc111f8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.828924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.854044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.854729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.855015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.855286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.856028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:27.856328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.857710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.865884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 263/508] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:27.866662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.878115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:27.888635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e69f65-d652-4ec5-a22c-42749fdfeb03 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:27.923795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:27.924555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:27.924900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:27.925212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:27.925947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:27.926257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:27.927656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:27.939135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 246/509] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:27.939946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:27.978296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674050d-c972-4bf2-8205-aa84278df0c8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.012275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.012952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.013278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.013548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.014275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:28.014582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.015964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.028145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 264/510] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:28.029035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.040407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d758-42d9-45ec-a54c-f97f1987f1f3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.058559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.074900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.075661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.075939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.076175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.086791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.088252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:28.105858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:28.106813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:28.107865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:28.107865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:28.107865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:28.107865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:28.107865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 247/511] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:28.108178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.112626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.132211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ed48-a11d-4be7-9f9a-2cd249a30410 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.168820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.169540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.169824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.170094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.170939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:28.171252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.172696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.189947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 265/512] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:28.190831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.208928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf0bc-e8a0-409e-9284-b95ae26fee0d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.242436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.243238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.243517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.243794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.254364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.255823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:28.272734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:28.274039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:28.274853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:28.274853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:28.274853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:28.274853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:28.274853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 248/513] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:28.275113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.276689 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.291611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795173b8-c27f-4543-871a-69f4afc0a7bc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.325742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.326474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.326755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.327026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.330911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.334392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.335848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:28.350269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:28.351291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:28.352265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 266/514] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:28.352821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.379527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2b67-f363-44c9-9f80-1ce17b8fcbde None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.413693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.414501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.414787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.415059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.423568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.425096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:28.438968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:28.440018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 249/515] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:28.441127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.460191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9019-343b-4dc7-962b-404c64b0cfd2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.493215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.493879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.494162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.494434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.495161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:28.495568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.496985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.509229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 267/516] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:28.509946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.520134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.541686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8210d-6312-4e87-9bad-7e03c477eb7f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.557257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.577309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.577894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.578173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.578444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.608987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b62d-1d30-4465-a5ae-4b5d4e6eaaa1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.644644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.645092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.645771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.646055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.646152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.646329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.647066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:28.647374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.649132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.660539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 268/517] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:28.661404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.727770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.744960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 250/518] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:28.745829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.762677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.769218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c448-514f-4b6c-a3dd-f53fb91383e1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.803036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.803735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.804014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.804283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.805058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:28.805373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.806846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.824543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 269/519] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:28.825468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.844720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08148e3-06d9-4563-9613-2b8935f50e63 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.878200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.878883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.879157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.879433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.880282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:28.880600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.882071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.918636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 251/520] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:28.919468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:28.926693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c618e81-b7e9-4132-a796-3c7be1b9c161 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:28.953603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:28.962367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:28.963082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:28.963380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:28.963645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:28.964361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:28.965984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:28.986322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 270/521] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:58:28 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:58:28.987126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.010572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.040526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45528-df3d-4f9f-809c-1fd9c97ce4e8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.083938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.085051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.085051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.085353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.093843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.095429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.106324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c31625-5d09-4d02-a171-591d17af3644 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:29.112726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:29.113865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 12:58:29.115070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:29.118998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 252/522] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:29.119868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.149776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.150591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.150882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.151161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.164995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.166565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:29.186333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:29.187269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:29.189975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:29.189975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:29.189975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:29.189975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:29.189975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 271/523] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:29.189975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.239063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.315838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d36e30-9bd8-45c6-bf53-5df4c7adeb88 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.354979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.355575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.355857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.356126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.361716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391575e-39ca-4a1c-8470-a57c904a0a40 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.397252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.398287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.398570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.398837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.399693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=4bfe0c829ddb45cbb59b275e4c8349f4) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:29.400009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.401486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.403424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.408057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 253/524] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/role_assignments?user.id=4bfe0c829ddb45cbb59b275e4c8349f4&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:29.409079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.441938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.444706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.497691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.529481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c2bff-d461-4cfd-9fb4-f563765093a6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.568650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.569454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.569714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.569994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.571228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:29.571228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.572677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.596399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 254/525] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:29.597147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.600642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 272/526] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:29.602193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.679016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.716255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b5d3-f86c-450f-abbf-c865fc1de1e6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.737086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba61e6-43db-4fb5-8f91-7701f4268f4e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.758502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.759527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.759816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.760085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.765036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.783481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.784961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.785464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.785994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.786936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:29.787389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.789781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.807014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 255/527] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:29.808143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.849713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.851690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.917690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407091a9-d6f7-48a2-9304-7d5b1a5a4657 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:29.934387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:29.953981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:29.955513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:29.955994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:29.956272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:29.961219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 273/528] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:29.962276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:29.967894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:29.970144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:29.992758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:29.993708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:29.994530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:29.994530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:29.994530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:29.994530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:29.995157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 256/529] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:29.996033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.002007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.075399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e793-1652-42ae-bf87-def252e75b96 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.107589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c423d-0347-4505-a4a8-3c0a09b6d9cd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.112793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.113724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.114007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.114283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.121941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.123411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:30.138479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:30.139364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:30.140180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 274/530] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:30.141230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.149389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.150482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.150955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.151537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.164157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.166010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:30.184731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:30.185664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:30.186471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:30.186471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:30.186471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:30.186471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:30.188971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 257/531] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:30.190219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.214612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.251757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.257778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84167c4-7452-46bd-b3aa-330cf59fa71a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.295228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.295907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.296186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.296460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.297328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:30.297639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.299179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.303679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba907840-5c8a-4bf9-a9c5-efd64af9cdbb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.312274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 275/532] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:30.313106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.340360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.341442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.342019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.342590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.343591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:30.344088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.346158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.368229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 258/533] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:30.370022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.423504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c68d-c95b-4197-bada-8c2fbf1503dd None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.465508 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.467033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.467524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.467986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.468338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.469587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:30.470860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.472753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.493040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 276/534] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:30.493040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.501982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a44404-f46e-4611-88b9-cee927213c73 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.513896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.549830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.550993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.551444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.551921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.559764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.561493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:30.577483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:30.578375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:30.579211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:30.581826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 259/535] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:30.583064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.601182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820d12e-3226-4ec0-a68b-14a506574329 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.642140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.643057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.643165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.643425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.644268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=82194f91a6fb4600988755c126818b66) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:30.644582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.646063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.652789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 277/536] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/role_assignments?user.id=82194f91a6fb4600988755c126818b66&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:30.653849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.699758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9e38-c3bd-4843-ac78-eb5ab597df74 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.740150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.741338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.741817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.742298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.743464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.751660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.754558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.757983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:30.763266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422bfc-c5d9-4d07-a12e-d22b189dc644 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:30.773601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:30.774499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:30.775315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:30.777997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 260/537] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:30.784294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.801319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.802090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.802332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.802610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.803472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:30.804014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.805381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.819669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 278/538] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:30.826949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:30.899743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f3e0-51fd-4c16-ab69-02f411ea7fa7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:30.942092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:30.943172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:30.943646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:30.944110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:30.945156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:30.945658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:30.947455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:30.965214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 261/539] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:30.967282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:31.037429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:31.040242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f5735-44e5-46c4-88ae-45a44f01dd21 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:31.077049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:31.077693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.077975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.078312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.079207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=643c0511de594207bf8fbdd5b295267f) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:31.079560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:31.081500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec0af2-3ccb-40e3-8d93-e665e66a6d1a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:31.088358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 279/540] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/role_assignments?user.id=643c0511de594207bf8fbdd5b295267f&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:31.088833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7aa95-a3ad-4c6e-84ed-afac66f65411 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:31.129630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:31.130686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.131160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.131651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.132762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=36b7fcbf1a134a5a874da581578981d3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:31.133326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:31.134988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603bbd3-6c8c-4305-a8d5-078ea3d7deae None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:31.142298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 262/541] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:30 2022] GET /identity/v3/role_assignments?user.id=36b7fcbf1a134a5a874da581578981d3&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:31.586016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248013-020b-44ab-be1e-c441e9f1b1c5 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.586560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248013-020b-44ab-be1e-c441e9f1b1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.586560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248013-020b-44ab-be1e-c441e9f1b1c5 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.588064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 280/542] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:31.593667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f8028-114a-4968-859e-47cfd3b6b079 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.594082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f8028-114a-4968-859e-47cfd3b6b079 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.594286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f8028-114a-4968-859e-47cfd3b6b079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3d9f8028-114a-4968-859e-47cfd3b6b079 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:31.623412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3d9f8028-114a-4968-859e-47cfd3b6b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:31.713754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 263/543] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:31.759897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248013-020b-44ab-be1e-c441e9f1b1c5 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:31.763908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:31.865628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc318c-4fa7-4180-9b01-68958912910c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.865945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc318c-4fa7-4180-9b01-68958912910c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.866185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc318c-4fa7-4180-9b01-68958912910c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.868154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 264/544] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:31.878473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.879067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.879534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.902905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248013-020b-44ab-be1e-c441e9f1b1c5 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:31.912960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:31.914199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:31.960516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:31.963090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:31.963378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:31.963686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:31.985574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:32.002378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:32.003258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:32.004044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:32.007357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:32.007468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 281/545] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:32.012988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.038993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 265/546] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:32.085641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.109407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:32.203948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34905c-40f8-4fa5-8b98-6dc32c6ecda6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.218266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71304b4-4557-4766-b65a-a06f9f5647a9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.254957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.255843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.256127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.256454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.267576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:32.276142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:32.276979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:32.277778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:32.278444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 266/547] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:32.285799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.317760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.318457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.318752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.319016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.319790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:32.320099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:32.321541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:32.335406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:32.341180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 282/548] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:32.351944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.404619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430408-1a7a-4ab9-9c3a-b3018c004b76 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.441488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.442483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.443061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.443471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.444417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:32.444855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:32.446395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:32.455964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 267/549] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:32.462370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.567621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef5e5-e722-44a3-977e-cabb2650bf7c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.618758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:32.643577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3d3a-78c5-425d-9f86-bec8baf43b80 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.645485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.646986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.647583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.648417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.653940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:32.677137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:32.678632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:32.701740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.702553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:32.710095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:32.711176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:32.712010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:32.712010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:32.712010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:32.712010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:32.712227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.712227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.721600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 283/550] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:32.722681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.727273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:32.728757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:32.746686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:32.747581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:32.749696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:32.749696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:32.749696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:32.749696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:32.749696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 268/551] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:32.758010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:32.881121 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1d41c-8115-4e79-ac1c-fac94c0d5c1a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.906485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef5a9-3aa5-4876-8441-a53de0092c4e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:32.949708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.951384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.952044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.953165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.954249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:32.955979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:32.957714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:32.976000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:32.976994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:32.977493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:32.977958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:32.978889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:32.979412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:32.980979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:32.988614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 284/552] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:32.991160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.007137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 269/553] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:33.013970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.045390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.061946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.140161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe9dad-f689-4247-b490-9886cabff578 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.178367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.179183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.179467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.179742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.180979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1289d-daee-4523-afc4-22a8463dd3f7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.187513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.189898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:33.206439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:33.207399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:33.208740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 270/554] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:33.213419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.274041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.275278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.275777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.276291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.290178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.292004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.299008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.320932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07755-189c-459f-bf59-4919e9dc1bb2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:33.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:33.326170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:33.327522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:33.333489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 285/555] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:33.339172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.358120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.358809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.359088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.359362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.360695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:33.361152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.362799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77effa-814a-43d6-89ac-d19fc9dd66df None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.384117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 271/556] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:33.390395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3250f3-cd0e-4bb8-a9ac-cd544e1cc7c2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.391847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3250f3-cd0e-4bb8-a9ac-cd544e1cc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.392117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3250f3-cd0e-4bb8-a9ac-cd544e1cc7c2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.394866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 272/557] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:33.395819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3250f3-cd0e-4bb8-a9ac-cd544e1cc7c2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.480983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abafb4a-6f92-423e-b46a-7adb4e507108 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.482727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.517768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.518628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.519008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.519381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.520400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:33.520812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.522794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eff056-053c-467e-b27c-cdea07746d0e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.523428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3250f3-cd0e-4bb8-a9ac-cd544e1cc7c2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.544497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 286/558] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:33.546104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.546504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.546879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.566593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:33.567684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.568279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:33.568523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.568806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.569132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.580272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.589042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.589042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:33.611648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:33.612512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:33.613460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:33.613460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:33.613460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:33.613460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:33.617258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 273/559] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:33.618614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.658114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 287/560] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:33.665558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.748379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1da6ba-66fe-4f37-bf2f-a3139863a09e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.781141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.795061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.796203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.799025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.799566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.799678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dec60-1011-4447-88a5-ca7ab45ef113 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.841279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:33.845791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:33.846391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:33.846877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:33.847937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:33.848475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.850228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.867812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 288/561] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:33.868869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:33.870280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:33.881399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:33.883342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:33.977599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53973320-a36d-49a9-8c43-29e41d8f163f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:33.988318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 274/562] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:33.989209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.012156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163961-8537-4af6-ad0d-60d8d34cd388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.012970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163961-8537-4af6-ad0d-60d8d34cd388 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.013307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163961-8537-4af6-ad0d-60d8d34cd388 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.013586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163961-8537-4af6-ad0d-60d8d34cd388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.024617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7163961-8537-4af6-ad0d-60d8d34cd388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b7163961-8537-4af6-ad0d-60d8d34cd388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:34.032361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.033430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:34.034290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 289/563] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:34.035143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406aac-d6f1-4f0e-8221-790ad96c5c83 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.035405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406aac-d6f1-4f0e-8221-790ad96c5c83 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.035669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406aac-d6f1-4f0e-8221-790ad96c5c83 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.036928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 290/564] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:34.038018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184517a-9972-41a1-a567-469f9fe5bf4a None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.038523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184517a-9972-41a1-a567-469f9fe5bf4a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.038644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184517a-9972-41a1-a567-469f9fe5bf4a None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.039831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 291/565] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:34.040519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184517a-9972-41a1-a567-469f9fe5bf4a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.050425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.084614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.098919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69d13-68f6-443b-a14c-7b9360a7b2e9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.136887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.137723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.137973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.138249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.145422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.146885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.147726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184517a-9972-41a1-a567-469f9fe5bf4a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:34.161109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.162049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:34.162899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 275/566] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:34.163643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.186524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.187324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.187608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.187881 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.198643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.200108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-528d7b06-dcf6-44a6-9a4d-778fb12a5469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:34.217105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.218133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:34.219009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:34.219009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:34.219009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:34.219009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:34.219009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 292/567] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:34.219451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf9bc-5356-4c4c-95a8-6177cce39d38 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.219735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf9bc-5356-4c4c-95a8-6177cce39d38 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.220008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf9bc-5356-4c4c-95a8-6177cce39d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.237807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a61bf9bc-5356-4c4c-95a8-6177cce39d38 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:34.239011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a61bf9bc-5356-4c4c-95a8-6177cce39d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:34.266407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17c606-f91f-4908-8f21-22498b610918 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.291609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.300638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.301279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.301558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.301831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.302585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:34.302915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.304281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.305472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 293/568] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:34.306734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.307020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.307294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.312819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 276/569] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:34.313635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.326577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.332659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:34.333882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:34.401181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 294/570] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:34.402042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.427973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e805f-2257-4aa3-87c4-de9f1c0ef238 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.463692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.464353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.464632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.464901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.465729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:34.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.467579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.480914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 277/571] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:34.481737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.518854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad50ce-eb1e-4436-bb83-1ce9fe06de47 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.537901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.555218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.555395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.556070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.556362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.556642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.557498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:34.557900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.559200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.570555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 295/572] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:34.571346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.590813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a486e6-7e9a-4d75-b1db-465200295a34 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.626390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.627228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.627547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.627806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.637753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.639199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:34.656697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.657701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:34.658785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:34.658785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:34.658785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:34.658785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:34.658785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 278/573] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:34.659214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.678651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f525f4-3994-4ad1-8194-30c569117bd0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.711684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.712490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.712792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.713099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.723805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:34.731614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.732528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:34.733588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 296/574] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:34.734627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.763583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be85578-1be5-4aab-93a6-7d031fbcbb90 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.773923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.787182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:34.799118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.799921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.800200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.800476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.810610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:34.818243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.819277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:34.820160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 279/575] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:34.820850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.833795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323955a-f08f-404e-89b3-a3d25600ba26 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.867875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.868798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.869092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.869367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/4bfe0c829ddb45cbb59b275e4c8349f4/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.884710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=4bfe0c829ddb45cbb59b275e4c8349f4, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.886197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.899590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 297/576] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:58:34 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/4bfe0c829ddb45cbb59b275e4c8349f4/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:34.900393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:34.928943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22ca4-8aab-4368-b7fc-0e2ba2c466f8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:34.969926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:34.971289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:34.971552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:34.971821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:34.980068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:34.981597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:34.997185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:34.998137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 280/577] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:35.004479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.032115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.047997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c448-d690-45e6-bcc4-7bbd1e5f4840 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.052096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.086734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.087327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.087611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.087885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.088628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.088941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.090424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.104395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 298/578] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.105112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.124401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa7ea-a36d-4071-8c14-0146e21fcb5d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.161395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.162077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.162359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.162636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.163397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.163704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.165120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.178376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 281/579] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.178376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.215731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cd92-fbe3-4db2-8b16-ceac4ec976c7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.250623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.251452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.251880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.252246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.253150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.253550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.255035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.264279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 299/580] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.265670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.282238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e520-c5e8-429b-948a-5c3c98829304 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.282857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.284872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.321164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.321835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.322119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.322397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.323202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.323541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.324993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.342810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 282/581] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.342810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.383773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108693-9ea7-46c9-aa01-985d925c6a6c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.422155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.422976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.423262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.423612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.431717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.433211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.447285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d643-5f95-4e5b-8f1b-a4644294a255 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:35.447783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:35.448685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 300/582] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:35.450461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.490180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.490986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.491270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.491538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.503536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.504977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.523606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:35.524052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:35.524957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:35.525881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:35.525881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:35.525881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:35.525881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:35.525881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 283/583] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:35.526146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.546092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.563813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74b5b3-e226-435b-a2e5-95e594de505b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.606253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.607159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.607506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.607843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.619283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.620811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.637152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03a652-45dd-40ac-870c-0e69afe407aa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:35.638320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:35.639214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:35.640078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:35.640078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:35.640078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:35.640078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:35.640078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 301/584] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:35.640342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.678861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.679644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.679914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.680184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.681046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.681366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.682791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.688685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 284/585] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/role_assignments?user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.689758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.779071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b8796-16d2-45d8-8aaf-f13a8969d69b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.805037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.818481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.819172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.819449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.819722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.820064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:35.820624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.820886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.822390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.848788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 302/586] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.849449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688188-b970-4c21-891f-f819259a4451 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:35.849929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.888306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:35.889296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:35.889585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:35.889860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:35.890867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:35.891177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:35.892760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:35.909998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 285/587] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:35.910317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:35.980854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1758d-54a8-4581-9fc4-3a5ff5e2bc0e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.017622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729b8d-f0e3-482f-9154-a0e8b79b6f40 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.018732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.019450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.019858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.020131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.020886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:36.021273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.022824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.041366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 303/588] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:36.042401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.060789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.061687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.062025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.062411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.073595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.075848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.077838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.094147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:36.109412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:36.110623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:36.111673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:36.111673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:36.111673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:36.111673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:36.111673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 286/589] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:36.112376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.158589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5d888-fce8-46a7-851e-f6751e8501b6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.194549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.195794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.196248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.196690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.205913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.207780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:36.223472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:36.224405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 12:58:36.225532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:36.226166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa0799-c859-47c9-b8fa-4ec80f1a4b52 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.232293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 304/590] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:36.233567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.263027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.263847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.264344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.264468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.272688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.274603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:36.289539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:36.290680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 12:58:36.291829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:36.295520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 287/591] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:36.296384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.341462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.345582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683aeff-666d-4ba5-87a1-7c4851a82343 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.351736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.383812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.384841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.385632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.386206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.387281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:36.387780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.389592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.402720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 305/592] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:36.402998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb28844-809c-423c-979c-59db2cac10ae None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.404046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.441516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.442138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.442404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.442682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.444253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:36.444253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.468376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 288/593] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:36.469502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.513304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccc2b-c6a3-4107-b2e3-e1f4aac76b1f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.551168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.552300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.552775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.553304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.554482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:36.554999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.556650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.573393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85a72d-d3b4-4343-9e94-33eac5446cf6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.580353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 306/594] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:36.581576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.589806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.610366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.628526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.630517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.630957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.631377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.640388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.642814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:36.662140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:36.663226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:36.664292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:36.667341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 289/595] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:36.668690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.708574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b5fa6-a65c-40c2-a914-d7be38fa3518 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.755082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.756182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.756680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.757399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.774109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.776383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.782662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a464da-330a-4299-a118-36fa8c6094dd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:36.802360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:36.803608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:36.804478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:36.804478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:36.804478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:36.804478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:36.812100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 307/596] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:36.812100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.828168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.830910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.831767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.832282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.849810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.851941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:36.877497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:36.878638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:36.879507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:36.879507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:36.879507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:36.879507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:36.887112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 290/597] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:36.887112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:36.903218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.915263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:36.945534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d16879-c707-41fc-a392-622d9aa2cd87 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:36.981877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:36.982901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:36.983401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:36.983872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:36.984868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:36.985444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:36.987307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.002162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 308/598] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:37.004434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.016669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc0f4-4759-4c2b-a552-80d32f6fc780 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.053214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.054255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.054764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.055240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.056193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:37.056719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.058336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.077103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 291/599] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:37.078295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.115437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0746d6-2e5f-4214-b0b2-cf6cb4d499c4 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.144174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:37.151852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.152547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.152888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.153139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.153874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:37.154179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.155560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.168258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 309/600] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:37.169114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.169561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:37.190830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebc9d-90e9-41de-b20e-60537ab241f4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.226635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a21c0-f5c9-41e6-8674-c4ae1fa455b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.227527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a21c0-f5c9-41e6-8674-c4ae1fa455b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.227805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a21c0-f5c9-41e6-8674-c4ae1fa455b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.228073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a21c0-f5c9-41e6-8674-c4ae1fa455b2 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/82194f91a6fb4600988755c126818b66/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.242755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a21c0-f5c9-41e6-8674-c4ae1fa455b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=82194f91a6fb4600988755c126818b66, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.244398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a21c0-f5c9-41e6-8674-c4ae1fa455b2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.258032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 292/601] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:58:37 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/82194f91a6fb4600988755c126818b66/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:37.271009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834480-87df-4029-92e1-ab1355f8231f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.272131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834480-87df-4029-92e1-ab1355f8231f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.273462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834480-87df-4029-92e1-ab1355f8231f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.280388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 293/602] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:37 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:37.280388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834480-87df-4029-92e1-ab1355f8231f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.292211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df511-8171-4993-a085-92b55e769414 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.346766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.348315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.349105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.349647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.361511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.364496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-8053fee4-60f6-4082-8b07-cd45c07f5cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:37.383809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:37.384776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:37.385705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:37.392380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 310/603] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:37.392380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879239df-3801-4730-b159-59ace4477114 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.392380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879239df-3801-4730-b159-59ace4477114 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.392380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879239df-3801-4730-b159-59ace4477114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.415587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-879239df-3801-4730-b159-59ace4477114 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:37.417042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-879239df-3801-4730-b159-59ace4477114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:37.424787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834480-87df-4029-92e1-ab1355f8231f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.472240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:37.484163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.485187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.485583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.485862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.487147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:37.499333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.501038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.516711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 311/604] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:37.517006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:37.517941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:37.518799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:37.519223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879239df-3801-4730-b159-59ace4477114 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.519300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 294/605] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:37.524768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.650468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd06c5b-6721-45cb-a44d-dd763455ceb4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.667543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879239df-3801-4730-b159-59ace4477114 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.688095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.689146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.689803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.690236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.691222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:37.691684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.693459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.708225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 295/606] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:37.710186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.724023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.724742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.724986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.725288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.726098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:37.726407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.727852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.740766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 312/607] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:37.741719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.791333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:37.792504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:37.855296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91c5d-3e24-4f9e-9674-d2cf0207eb28 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.870008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0d855-f057-4f6d-8663-278d3cc9a2c0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:37.898765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.899902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.900261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.900599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.911651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:37.912812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:37.913296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:37.913760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/36b7fcbf1a134a5a874da581578981d3/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:37.913910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:37.923907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:37.924968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:37.925826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 296/608] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:37.926502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:37.938156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=36b7fcbf1a134a5a874da581578981d3, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:37.940067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:37.958878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 313/609] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:58:37 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/36b7fcbf1a134a5a874da581578981d3/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:37.960206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.072598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:38.086345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188da80-6201-4b97-8fbd-a5a601d60714 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.090873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec4a7-d3b0-423a-b094-8e301392ba1d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.111799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:38.128664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.129445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.129729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.129999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.130762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:38.131068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:38.132460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465517e1-ece5-4435-a6e1-8c0e4b9222dc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:38.147173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 314/610] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:38.147173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d6a6-e418-4baf-ac8d-3b5a3751ff96 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.147173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d6a6-e418-4baf-ac8d-3b5a3751ff96 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.147173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d6a6-e418-4baf-ac8d-3b5a3751ff96 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.150000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbb04-4d87-4252-81b2-272dd49175dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.151065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 315/611] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:38.151517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbb04-4d87-4252-81b2-272dd49175dc None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.152008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d6a6-e418-4baf-ac8d-3b5a3751ff96 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.152203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbb04-4d87-4252-81b2-272dd49175dc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.152748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbb04-4d87-4252-81b2-272dd49175dc None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/643c0511de594207bf8fbdd5b295267f/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.175265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbb04-4d87-4252-81b2-272dd49175dc None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=643c0511de594207bf8fbdd5b295267f, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:38.177247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbb04-4d87-4252-81b2-272dd49175dc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:38.205318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 297/612] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:58:37 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/643c0511de594207bf8fbdd5b295267f/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:38.207181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.207598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.207957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.235520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:38.236961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:38.314644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d6a6-e418-4baf-ac8d-3b5a3751ff96 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.335022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 298/613] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:38.362987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.379567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.380412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.380942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.382893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.406983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:38.408521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:38.441377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:38.443552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:38.444629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:38.444629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:38.444629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:38.444629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:38.444629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 316/614] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:38.451617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.466532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:38.511466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:38.524672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d61d9-15b8-4d6b-bdb1-c105c1958587 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.589181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.589181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.589181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.589181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.589817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e306-0612-4342-9d34-9a554d8387ab None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.624236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.624924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.625253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.625664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.626407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:38.626753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:38.628138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:38.629349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:38.637332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:38.638257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:38.639084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:38.641119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 317/615] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:38.646323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 299/616] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:38.646792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.664375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.741444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:38.764497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac733ad-fcb2-4a66-aae5-63b6c3ce256c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.803692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.804758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.805064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.805368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.815260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:38.817654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:38.835677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:38.837916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:38.840289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 318/617] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:58:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:38.845285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:38.895972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebca0b9-414a-4f30-8dff-3eebe29324cf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.954130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab1cdb-004a-47bd-8992-de3d81688c5b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:38.975735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:38.976426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:38.976703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:38.976976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:38.977822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:38.978231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:38.979657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:38.985459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:38.996456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 300/618] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:39.003414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.006015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.006723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.007047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.007325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:39.008236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:39.008550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:39.010038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:39.043264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:39.054646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 319/619] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:58:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:39.063158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.170663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05dbf-b022-4f94-a8f1-2de611ae3f20 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:39.206263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.206929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.207247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.207480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:39.228306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e87ee-e4f4-4dd7-a851-d8601d98c00d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:39.270560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.271525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.271814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.272094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:39.280785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:39.290166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:39.291657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:39.322442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:39.323401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:39.324734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:39.324734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:39.324734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:39.324734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:39.324976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:39.330690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:39.332676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 301/620] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:39.339639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.481141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:39.536703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e871-1a7d-4c72-984b-3cb476f27a8e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:39.538658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 320/621] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 12:58:39.539602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.616667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.617394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.617679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.617961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:39.618707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:39.619113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:39.620592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:39.637610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:39.650751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 302/622] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:39.655839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.673090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95191f7-d198-4e3d-ae2e-8237443623cb None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:39.712366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.713387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.713669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.714284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:39.727587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:39.729487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:39.750403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:39.751303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:39.753276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:39.753276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:39.753276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:39.753276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:39.753276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 321/623] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:39.757894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.867615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254371d1-cc9f-4d57-8098-7b59f4b07198 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:39.904988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.905821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.906107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.906382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:39.907431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:39.907735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:39.909332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:39.922523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 322/624] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:39.925515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:39.928570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:39.943011 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12a58-b23f-435d-8e0f-8515723ee6e8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:39.984112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:39.995670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:39.996627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:39.996912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:39.997211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.006766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.009007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-567bd32d-72ee-48ea-b1f8-5ebc628cc1cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:40.028308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:40.029542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:40.030655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:40.034887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 303/625] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:40.036563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab13328-98bd-432c-99c6-cc0487ad86cb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.036848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab13328-98bd-432c-99c6-cc0487ad86cb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.037153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab13328-98bd-432c-99c6-cc0487ad86cb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.038774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 304/626] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:40.039610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab13328-98bd-432c-99c6-cc0487ad86cb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.056096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6278-55b9-47ec-93c3-9a9b0295391c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.102387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.103386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.103675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.103950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.113475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.115096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-96ee9294-970e-44e7-bcae-951491758b3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:40.133287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:40.134379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:40.135438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 323/627] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:40.140418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.140418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.140418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.156193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:40.157891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:40.161701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab13328-98bd-432c-99c6-cc0487ad86cb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.209976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.210678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.210960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.211230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.212117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:40.212422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.214526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.222383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:40.241127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 305/628] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:40.242318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.254312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 324/629] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:40.255723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.309084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:40.366279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd6602-7355-4239-b2ac-bf312936921d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.384566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cb7e0-31ef-429b-92ba-b539554209f2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.403047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.404063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.404523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.404974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.406100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:40.406589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.408357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.426323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.426323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.426323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.426323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.426878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 306/630] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:40.427915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.437627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.439208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:40.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:40.459900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:40.460886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:40.460886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:40.460886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:40.460886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:40.464735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 325/631] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:40.465666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.503137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:40.539247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fc8e2-987e-47f5-88d6-d5959cc86b63 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.542155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:40.581567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.581763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52787-b1d9-4f71-a1b5-8baef143c6e5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.582323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.582606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.582880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.593708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:40.601527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:40.602608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:40.603451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 307/632] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:40.604442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.625995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.626694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.626980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.627256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.628098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=4bfe0c829ddb45cbb59b275e4c8349f4) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:40.628413 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.629895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7951-5267-43dd-b317-a5978dead5e1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.635969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 326/633] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/role_assignments?user.id=4bfe0c829ddb45cbb59b275e4c8349f4&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:40.637341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f73ff-045b-418d-89ca-04bfba81bfda None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.637625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f73ff-045b-418d-89ca-04bfba81bfda None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.637901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f73ff-045b-418d-89ca-04bfba81bfda None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.639335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 327/634] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:40.641854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f73ff-045b-418d-89ca-04bfba81bfda None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.759446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b8609-2160-4ccb-9bf9-4f8928463ee2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.766934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:40.773338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f73ff-045b-418d-89ca-04bfba81bfda None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.803277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.804280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.804737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.805322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.806081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:40.806393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.808028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762315-080b-48b8-bff6-977bc8a88b10 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.814794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.815852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.816443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.816947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.817994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:40.818599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:40.820287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:40.822162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 308/635] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:40.823520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.823805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.824083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:40.831862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 328/636] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:40.833188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.842094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:40.843706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:40.865372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:40.929157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 309/637] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:40.930511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:40.955278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102d11d-07fd-4ee6-986b-456b3a68088e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:40.996597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:40.997442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:40.997728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:40.998007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.005414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.007408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-976a44d8-1ad9-41c5-b37d-ccf05c72f3a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:41.031014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:41.032146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:41.033361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 329/638] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:41.035219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b58ae3-a726-4f09-9030-11c9242da8ac None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.035694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b58ae3-a726-4f09-9030-11c9242da8ac None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.036159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b58ae3-a726-4f09-9030-11c9242da8ac None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.038620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 330/639] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:41.039787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b58ae3-a726-4f09-9030-11c9242da8ac None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.046605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b19bd3-cba0-4121-b7f9-b63cdc16bc13 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.069939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.086382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.087470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.087928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.088375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.099782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.101517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:41.120563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:41.121502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:41.122363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:41.122363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:41.122363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:41.122363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:41.122363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 310/640] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:41.122628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.133524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.161122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b58ae3-a726-4f09-9030-11c9242da8ac None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.196121 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbba65-de09-420f-af05-4c52877a09f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.196926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbba65-de09-420f-af05-4c52877a09f2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.197232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbba65-de09-420f-af05-4c52877a09f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.197504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbba65-de09-420f-af05-4c52877a09f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.208723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbba65-de09-420f-af05-4c52877a09f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-59dbba65-de09-420f-af05-4c52877a09f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:41.216406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:41.217405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:41.218264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 331/641] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:41.219435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.219541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.219812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.236616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:41.236803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd71b38-7104-4582-bfa3-4be6f346567a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.237827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:41.272268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.273316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.273900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.274174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.274973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:41.275291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.276699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.289366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 311/642] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:41.290194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.318939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 332/643] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:41.320089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.343442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.374329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.412867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2849e0c-7a63-4bc5-ae92-4d274a46b884 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.436806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6addc49-dabb-463c-8cce-1d6c314faf85 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.450804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.451914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.452160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.452382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.453153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:41.453465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.455419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.467984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 312/644] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:41.468800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.479090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.480037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.480037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.480302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.481075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:41.481383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.482754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.491349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 333/645] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:41.492171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.572708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.591039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd187b-e906-42b0-9bdb-e95e71e6f646 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.601592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9898-202e-41ea-9ec2-4f77f8b4809e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.626424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.635039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.635854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.636132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.636401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.636726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.637823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.638219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.638497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/c3a96be7cce14b2e964bb6f3ff2d9b7a/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.648318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:41.654160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=c3a96be7cce14b2e964bb6f3ff2d9b7a, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.655617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:41.655934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:41.656893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 334/646] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:41.663073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.685364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 313/647] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:58:41 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/c3a96be7cce14b2e964bb6f3ff2d9b7a/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:41.685364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.798826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f28c-4bcf-4c9d-8fd3-d8d15ceebe80 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.801461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb39af-633e-4371-8800-644cd6ef06d9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:41.838732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.839977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.840751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.841287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.845827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:41.846657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:41.846939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:41.847213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:41.850476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:41.856253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.858746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.859035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:41.860740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:41.879958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:41.881058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:41.881985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 335/648] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:41.883258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:41.885649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:41.887635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:41.889729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:41.889729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:41.889729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:41.889729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:41.889729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 314/649] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:41.895863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:41.934004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.008422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299623d2-879a-4cba-a6c9-c43c8eba193e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.039785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbae809-1dce-4289-9f55-b0f46924cda3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.044870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.045656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.046033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.046375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.047197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:42.047567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.049155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.058456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 336/650] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:42.063745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.079560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.080639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.081025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.081472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.082414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:42.082793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.084411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.103969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 315/651] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jun 7 12:58:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:42.105022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.128565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.180656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8152a-dbcc-416f-9087-2e0061a32abc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.203300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.220634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463311-8e0f-4a5a-a5b6-6939c12ec1ea None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.224574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.225513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.225943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.226354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.227221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:42.227667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.229656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.245766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 337/652] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:42.247442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.257587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.258378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.258727 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.259073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.269865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.271401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:42.290759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:42.291679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:42.292620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:42.292620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:42.292620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:42.292620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:42.292620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 316/653] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:42.292884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.355417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde73e9-3a6d-47cf-a73c-9d2a604ff09a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.373576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.392692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.393674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.394130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.394569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.409646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157153-efe7-400c-b85a-6ea3639bd31b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.448817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.449662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.449943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.450236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.458700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.460055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.461994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.465862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.467534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:42.478190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:42.479146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 12:58:42.480046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:42.484511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 317/654] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:42.485469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.574105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 338/655] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:42.575250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.593311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.610452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f6997-8b60-43ae-a784-dc7c0848e1da None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.650337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.651035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.651376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.651713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.652525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:42.652890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.654367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.668384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 318/656] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:42.669597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.681213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5608e-882f-42fa-b63f-1673017f47a6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.724653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.725356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.725597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.725901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.726749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:42.727054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.728506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.743141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.751552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 339/657] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:42.752740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.791778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9e95a-353a-4c45-a786-22affca0670c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.828334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:42.831345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.832471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.833028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.836988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.846574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.848509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.854167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487da17b-2756-469d-b058-434d7982ea19 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:42.867769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:42.868685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:42.869617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:42.869617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:42.869617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:42.869617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:42.876472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 319/658] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:42.877707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.889211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:42.890027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:42.890303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:42.890570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:42.898590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:42.900046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:42.915218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:42.916227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:42.917182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 340/659] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:42.917768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:42.995820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb5100-777d-4603-9723-df4111cca5e9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.008279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.022459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718426b9-b868-4ded-afed-6d1c9fdd40fa None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.037895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd83a41-7057-470a-922d-a70531f4af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.038624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd83a41-7057-470a-922d-a70531f4af69 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.038908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd83a41-7057-470a-922d-a70531f4af69 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.039184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd83a41-7057-470a-922d-a70531f4af69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.057964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.058881 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.059167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.059436 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.060166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:43.060468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.061872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.063357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.080193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 341/660] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:43.080193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.119315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd83a41-7057-470a-922d-a70531f4af69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.120879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd83a41-7057-470a-922d-a70531f4af69 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.182944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29081e8-458f-4b76-aeeb-da7f7b53ad4f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.218822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.219502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.219782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.220191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.221189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:43.221505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.222950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.228260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 320/661] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:43.228260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40466df1-19c9-4c27-95c6-bcd9aa03b344 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.228260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40466df1-19c9-4c27-95c6-bcd9aa03b344 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.228260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40466df1-19c9-4c27-95c6-bcd9aa03b344 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.231274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 321/662] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:43.231951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40466df1-19c9-4c27-95c6-bcd9aa03b344 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.244781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.251506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 342/663] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:43.251506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.311441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.337523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40466df1-19c9-4c27-95c6-bcd9aa03b344 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.362109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379940c6-2fb1-425d-b2e9-62ad24be6e4a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.377042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.378103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.378383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.378806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.388169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.390337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.396107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.396908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.397311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.397576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d0ead57d-ca79-4351-89a8-686013e1a88b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:43.408083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:43.408924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:43.410107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:43.410533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.410605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 322/664] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:43.411002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.411263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.411545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.412391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.429544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:43.430730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:43.432272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:43.433213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:43.434104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:43.434104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:43.434104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:43.434104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:43.434104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 343/665] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:43.434380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.505541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.510089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 323/666] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:43.513998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.544496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141c87-2587-4880-ae9c-6fcd6e6cb627 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.548303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.587220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.587884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.588168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.588443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.629007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beb279-348c-4588-b403-c5739ab4d350 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.665304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.665554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.665973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.666251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.666520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.666790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.667310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:43.667632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.669049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.685761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 324/667] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:43.685761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.757396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.780854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 344/668] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:43.781815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.787069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:43.806982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b91317-d0d7-442c-8473-eb597f111c2d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.845402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.846332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.846618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.847292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.848309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:43.848624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:43.850283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:43.864519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 325/669] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:43.865640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.890834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b66dd-8b02-43a7-82fe-4615f5553c04 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.927827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:43.929190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:43.929469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:43.929792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:43.940550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:43.948026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:43.948926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:43.950047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 345/670] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:43.950721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:43.974222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a83e2-654e-4056-a5b1-519fb640f142 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:43.996085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.010844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.011515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.011800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.012077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.012925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=82194f91a6fb4600988755c126818b66) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:44.013270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.014711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.020572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.021253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 326/671] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/role_assignments?user.id=82194f91a6fb4600988755c126818b66&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:44.022125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.082056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d02e2-789a-42e2-a256-1a888e6dbb9e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.124061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.124914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.125221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.125492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.138345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.139867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.146470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775f3b-8bab-4449-b385-904aae30c7d7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:44.166242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:44.167375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:44.168426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:44.168426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:44.168426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:44.168426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:44.174863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 346/672] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:44.174863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.189000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.190733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.190733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.190946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.198546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.200030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-510b9e9d-80d1-45b2-b446-28fb42ccfbf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:44.215382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:44.216377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 327/673] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:44.217980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16c2f-e390-48a5-a37a-adfa7163a3a8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.218515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16c2f-e390-48a5-a37a-adfa7163a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.218515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16c2f-e390-48a5-a37a-adfa7163a3a8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.219949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 328/674] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:44.222098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16c2f-e390-48a5-a37a-adfa7163a3a8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.280531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.294617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c502c-ac8d-46bc-b2b5-631a83ef2422 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.311044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.329573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.330349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.330703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.331089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.331866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:44.332175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.333578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.343156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 347/675] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:44.343933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.356020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16c2f-e390-48a5-a37a-adfa7163a3a8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.395418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.396239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.396591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.396958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.398592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:44.398974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.400639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcfd37-3b2f-494d-aa6b-1a258d3c5dd6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.415206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 329/676] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:44.416816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.417182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.417509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.436150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:44.437353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:44.454359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd8859-3a57-4a90-994d-ee5931c8715e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.488918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.489688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.489992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.490266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.491059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:44.491367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.492783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.504781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 348/677] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:44.505709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.525034 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 330/678] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:44.525034 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.553942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.563916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.626321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc2306-9a2c-4ead-a823-29df4c137998 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.635171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbdc4a-b671-4a55-997a-5a06dd38c7f9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.662212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.663023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.663314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.663599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.670297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.671101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.671382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.671653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.674389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.675853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.679191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.680611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:44.694205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:44.695108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:44.695994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:44.695994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:44.695994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:44.695994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:44.696228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:44.696994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:44.698520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:44.700331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 349/680] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:44.700547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 331/680] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:44.701049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.701264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.801396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.806844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:44.809343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75ac6-4ab8-4916-844c-869bc28e116a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.817316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2d540-64a7-457d-bcdb-078870f981f1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:44.846605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.847715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.848149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.848429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.852591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:44.853292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:44.853584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:44.853911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:44.854761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=36b7fcbf1a134a5a874da581578981d3) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:44.855078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:44.856840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:44.859161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:44.873362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 350/681] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/role_assignments?user.id=36b7fcbf1a134a5a874da581578981d3&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:44.873362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:44.873755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:44.874759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 332/682] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:44.875775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.006454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73107a-65a0-46cc-8ac2-c97310f129f6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.007354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e0fc4-c63d-4a54-ab2f-239c0299e1c9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.046155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.046961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.047318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.047664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.048688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:45.049205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.050743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.053221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.054627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.055056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.055465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.056357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:45.056801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.058370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.065567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 351/683] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:45.066672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.076485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 333/684] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:45.077617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.088853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:45.098211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:45.191777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6f2c-1126-41d9-90a9-2c199e4b771d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.201980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903c0b-2ad2-4508-b8da-b36514d38beb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.227250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.228195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.228629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.229067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.229946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:45.230390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.231906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.239329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.240015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.240301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.240582 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.241493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=643c0511de594207bf8fbdd5b295267f) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:45.241854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.242002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 352/685] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:45.242946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.243232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.250292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 334/686] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/role_assignments?user.id=643c0511de594207bf8fbdd5b295267f&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:45.258296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.329593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:45.360276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26817-f6d7-47a0-9b58-9235bf75c4e5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.421417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:45.446914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c2131-209b-4b02-b6e2-52f76fb84970 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.451461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.452509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.452943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.453383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.470565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.472324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:45.495729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:45.496886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:45.498037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:45.502323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 353/687] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:45.510372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.533844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.534847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.535227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.535590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.559045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.560643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:45.587703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:45.588663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:45.589687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:45.589687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:45.589687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:45.589687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:45.596092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 335/688] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:45.597520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.629662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276763b-38fe-44bf-8498-f27105a56187 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.671837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.673327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.673780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.674400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.675554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:45.676275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.678235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.682125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:45.702455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 354/689] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:45.711556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.725740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029895c-b3e7-4b8a-8a87-48a3af73e882 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.761002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:45.768574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.769385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.770798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.771138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.771967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:45.772336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.774171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:45.791565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 336/690] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:45.792911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:45.841800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3910b-307d-48c3-a5a2-1785f5b712b8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.886006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.886978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.887376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.887741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.913785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52c6b-8079-4858-90e3-e311465cc0d2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:45.958853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:45.959666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:45.959941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:45.961341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:45.977887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:45.979362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:46.008543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:46.009675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:46.010591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:46.018648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 337/691] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:46.018852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.023480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.040304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.041872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.085393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.136213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2edf0-4c8c-4cf6-9ca1-0635fbb2ef7f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:46.171425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:46.172112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.172394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.172672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.173650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:46.173963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.175394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.217906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 338/692] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:46.223607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.228748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 355/693] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:46.235141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.383414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.391834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71ff4-0b78-4aa7-be7e-a3e31040af4e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:46.409237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c4d7-38af-4275-b9fc-d108493b8540 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:46.419140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.431303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:46.432501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.432787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.433089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.444643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.446143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.448074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b136e7-8fc2-400e-86d1-357b152c7c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:46.449123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b136e7-8fc2-400e-86d1-357b152c7c01 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.449576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b136e7-8fc2-400e-86d1-357b152c7c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.450087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b136e7-8fc2-400e-86d1-357b152c7c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-cd5fc6ce-5585-4acc-a7d1-83585612caa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:46.464518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:46.465586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:46.466456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:46.466456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:46.466456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:46.466456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:46.466456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 356/694] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:46.467332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd649c-65dc-4c23-91ca-dab05d9c7488 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.467614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd649c-65dc-4c23-91ca-dab05d9c7488 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.467997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd649c-65dc-4c23-91ca-dab05d9c7488 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.476931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 357/695] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:46.476931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd649c-65dc-4c23-91ca-dab05d9c7488 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.529686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b136e7-8fc2-400e-86d1-357b152c7c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.531440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b136e7-8fc2-400e-86d1-357b152c7c01 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.612065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd649c-65dc-4c23-91ca-dab05d9c7488 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:46.642028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 339/696] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 12:58:46.643892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.644385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.644857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.661073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:46.661753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.662034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.662304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.663031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:46.663384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.663565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:46.664806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.665198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:46.667869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.685139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 358/697] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:46.686328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.698713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.769048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 340/698] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:46.769048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.837168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8549e-bba2-429b-8142-89201441d095 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:46.880476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:46.881348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.881630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.881902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.898492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a279e1-defe-429d-831e-004769bc3fb3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:46.898675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.900211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:46.924266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:46.925235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:46.926109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:46.926109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:46.926109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:46.926109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:46.929092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 359/699] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:46.930149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:46.951873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:46.953204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:46.953489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:46.953765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:46.963767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:46.965528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:46.968248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:46.985940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:46.987230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:46.988116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:46.992082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 341/700] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:46.993624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.007012 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:47.056676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94008-a70d-46ad-b526-bbf96ed9e062 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.093918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.095173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.095868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.096393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.097328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.099175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:47.115703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:47.116806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:47.117654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:47.125239 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 360/701] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:47.126758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.149827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141781-f378-4677-99b4-089dddf83f7f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.186231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.187257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.187755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.188219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.189318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:47.189875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.191444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.208843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 342/702] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:47.210049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.257341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b25086-eb7d-475f-9ed0-e1bf585682ab None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.278316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:47.287175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:47.303221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.304343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.304634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.304955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.306506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:47.306824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.309313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.324536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 361/703] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:47.325990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.339482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d26c8-0b52-4d2f-a7e9-5b9725834b4e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.385599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.386283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.386566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.386844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.387565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:47.387873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.390082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.400757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 343/704] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:47.400757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.446576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed372ed5-c330-4d7d-be0d-d0edb84f23c2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.485194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.486089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.486338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.486608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.494180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.495635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:47.510670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:47.511799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:47.512851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 362/705] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:47.513700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.526120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742541c-635d-459a-9f87-616186e2a410 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.552276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:47.562455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:47.568100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.568850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.569223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.569689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.571173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=4bfe0c829ddb45cbb59b275e4c8349f4) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:47.571661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.573263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932a13-e8ab-42ac-91bd-ba134bd5e299 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.580922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 344/706] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/role_assignments?user.id=4bfe0c829ddb45cbb59b275e4c8349f4&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:47.582141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142932-f31d-44ac-b1d5-67fcf81890e8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.582434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142932-f31d-44ac-b1d5-67fcf81890e8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.582714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142932-f31d-44ac-b1d5-67fcf81890e8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.588977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 345/707] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:47.588977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142932-f31d-44ac-b1d5-67fcf81890e8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.669975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41a163-9973-48e6-8725-e75306370f04 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.731236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.732580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.733607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.734093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.735310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:47.735831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.738965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb1c6-a20b-4d38-a061-5a5faa2a3e02 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.745364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142932-f31d-44ac-b1d5-67fcf81890e8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.753074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 363/708] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:47.757004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.757364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.757585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.786925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:47.788184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:47.824472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:47.825224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:47.825501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:47.825774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:47.826595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:47.826906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:47.828395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:47.844035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 346/709] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:47.850187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:47.909479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:47.923011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 364/710] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:47.962730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb9617-a3d6-4837-96b5-d4139057f773 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:47.966603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:48.008519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.009258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.009541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.009815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.010727 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:48.010978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.012498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8839-2640-4719-a70a-a6669983aa7e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:48.025148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 347/711] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/role_assignments?user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:48.056752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:48.105763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1a34-1ce3-4531-a4b3-f5611e78800d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.106102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1a34-1ce3-4531-a4b3-f5611e78800d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.106334 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1a34-1ce3-4531-a4b3-f5611e78800d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.108070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 348/712] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:58:48.113998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.114390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.114544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.157491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:48.158755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:48.163827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95c408-38d4-4169-b4af-d19cd331aed2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:48.239525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.240807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.241323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.241820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] PATH_INFO: `/v3/services/network` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.243817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.246940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:48.261409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 349/713] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:48.269953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:48.271323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:58:48.272242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:48.279484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 365/714] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:47 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:48.280806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:48.290178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:48.339814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:48.415036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ebfa5-47da-48fe-82b2-eba426e2c8dc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:48.441190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:48.446584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12a2a-c685-4b76-a9cc-89a66fa0c63b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:48.461290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.461970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.462256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.462532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.463267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:48.463576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.465821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:48.472965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 350/715] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:58:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:48.479214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:48.493988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.495525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.496015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.496537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.511187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.513072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:48.541350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:48.542319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:48.543198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:48.543198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:48.543198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:48.543198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:48.545610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 366/716] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:48.551122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:48.617058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf33da-dec6-4423-9a28-1871cef2f9c8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:48.617058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:48.660779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.661905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.662193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.662634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.663474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] RBAC: Adding query filter params (type=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:48.663788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.665937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:48.673983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 351/717] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:58:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:48.688307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e17ca-c5d9-4372-b994-57f4a6f8694f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:48.728478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.729196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.729476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.729748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.730489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:48.730860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.732310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3f1ba-1d0b-433d-841e-ec0cd506501f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:48.747971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 367/718] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:48.758261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:48.932233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c176a0-5736-44a8-8fae-5f525b535d49 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:48.974184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e6923-1845-4451-9d79-6f55ca76fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:48.974881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e6923-1845-4451-9d79-6f55ca76fa37 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:48.975162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e6923-1845-4451-9d79-6f55ca76fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:48.975438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e6923-1845-4451-9d79-6f55ca76fa37 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:48.976172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e6923-1845-4451-9d79-6f55ca76fa37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:48.977687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e6923-1845-4451-9d79-6f55ca76fa37 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:49.003277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 352/719] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:58:48 2022] POST /identity/v3/users => generated 254 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:58:50.091577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca249ce-69ff-4397-8dde-88b33f0432e6 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.092591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca249ce-69ff-4397-8dde-88b33f0432e6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.093105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca249ce-69ff-4397-8dde-88b33f0432e6 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.094952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 368/720] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:50.100537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.101352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.101841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.119163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:50.120662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:50.138822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:50.215747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 353/721] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:50.262529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca249ce-69ff-4397-8dde-88b33f0432e6 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:50.281430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:50.377964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca249ce-69ff-4397-8dde-88b33f0432e6 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:50.420052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:50.420911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.421219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.421490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.437045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:50.445306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:50.446293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:50.447094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:50.451661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 369/722] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:50.453178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:50.581463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc81e3-7228-452c-9314-48d2f3cbf76c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:50.636194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:50.636803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.637109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.637388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.638160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:50.638466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:50.639847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ad727-5fb8-43e6-b708-0156510d8380 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:50.649804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 354/723] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:50.655403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:50.750040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:50.793290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a036-1b13-4627-8474-4db5ea84e3be None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:50.806701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176fa6-1bb2-4a5e-b795-436120447330 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.807041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176fa6-1bb2-4a5e-b795-436120447330 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.807264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176fa6-1bb2-4a5e-b795-436120447330 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.809089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 355/724] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:50.815177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.815481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.815769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.837861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:50.839107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:50.858571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:50.859439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:50.859722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:50.859997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:50.865418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:50.883912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:50.885434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:50.912910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:50.913857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:50.915178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:50.915178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:50.915178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:50.915178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:50.915178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 370/725] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:50.920041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.003212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 356/726] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 12:58:51.060159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14302-ef0a-4cf6-b42f-d574f3c618f0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:51.064483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.096731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:51.099273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:51.099958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.100243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.100522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.101287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:51.101596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:51.102990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:51.144396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 371/727] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:51.158800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.234563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03a36-af75-48c6-8d46-66883cf05770 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:51.269711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75898b-479a-4b4b-ae5d-4c6cd34894d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:51.270391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75898b-479a-4b4b-ae5d-4c6cd34894d5 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.270674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75898b-479a-4b4b-ae5d-4c6cd34894d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.270948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75898b-479a-4b4b-ae5d-4c6cd34894d5 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.271689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75898b-479a-4b4b-ae5d-4c6cd34894d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:51.273471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75898b-479a-4b4b-ae5d-4c6cd34894d5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:51.282702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808129f-0484-432e-82f8-b4e2fc33d2ef None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:51.293471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 357/728] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:58:51 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:58:51.295330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19e53-46b8-4141-8e95-2cd7dbe55e70 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.295617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19e53-46b8-4141-8e95-2cd7dbe55e70 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.296329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19e53-46b8-4141-8e95-2cd7dbe55e70 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.298188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 358/729] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:51.310997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ed595-8655-4648-a5ab-8fb5809ff196 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.311334 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ed595-8655-4648-a5ab-8fb5809ff196 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.311558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ed595-8655-4648-a5ab-8fb5809ff196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.342900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:51.344470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-068ed595-8655-4648-a5ab-8fb5809ff196 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:51.347043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-068ed595-8655-4648-a5ab-8fb5809ff196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:51.363672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:51.364577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.364842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.365138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.383360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:51.386922 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:51.416521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:51.418698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:51.420880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:51.425056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 372/730] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:58:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:51.431891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.476878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 359/731] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:51.478392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80917-a5df-4110-a0a5-aed65bf1a928 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.478679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80917-a5df-4110-a0a5-aed65bf1a928 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.478952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80917-a5df-4110-a0a5-aed65bf1a928 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.480454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 360/732] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:51.487308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.487603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.488033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.510367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:51.511549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:51.520099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:51.610329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b700c73-6eee-4477-8c6e-0ce675f35fb4 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:51.618740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 361/733] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 12:58:51.625056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.662787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:51.663856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.664341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.664834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.665908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:51.666438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:51.668092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:51.688151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 373/734] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:58:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:51.690200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.718222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:51.759647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74090ce-2922-47bc-9e5c-1fb44c5019f4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:51.795422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:51.796245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.796523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.796825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.805760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:51.808172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:51.810204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad11f4-d5a3-47c5-b020-b54fab4d5cf3 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:51.817227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:51.818148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:51.818970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 362/735] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:51.820201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:51.855966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:51.857059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:51.857553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:51.858035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:51.858982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:51.860709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:51.885368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 374/736] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:58:51 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:58:51.886742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.007816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a618-8a5e-44db-a6e8-9e48d7bab0bd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.068196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.085898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd239f7-5ba3-42de-a6b6-3ed0f4e10033 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.090194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.091345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.091844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.092307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.114708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.116312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.138736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.140195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.140674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.141211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.142167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:52.142799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.144391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:52.144501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:52.145354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:52.146216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:52.146216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:52.146216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:52.146216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:52.150650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 363/737] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:52.156004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.157769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 375/738] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:52.164033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.186546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.293647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a941ce-206b-4d3e-8faf-b4bc6109647a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.307373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047e50f-ede5-42c9-8443-3714e5a49789 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.341550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.342267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.342551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.342828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.345312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.346250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.346669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.347114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.347986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:52.348431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.349969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844aa49-d009-4534-bc79-e5a9bc5b4b53 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.358323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.360470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.364932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 364/739] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:52.366559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d4210-bc15-4ed4-a5ca-5dc155852a7d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.366984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d4210-bc15-4ed4-a5ca-5dc155852a7d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.367393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d4210-bc15-4ed4-a5ca-5dc155852a7d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.369280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 365/740] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:52.370146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d4210-bc15-4ed4-a5ca-5dc155852a7d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-971aa10d-e7f5-4d0e-b583-47e09b5b0e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:52.387863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:52.389159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:52.390171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:52.390171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:52.390171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:52.390171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:52.390171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 376/741] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:52.390766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.391051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.391328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.414277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:52.415480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:52.418311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.487670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.494034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 377/742] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:52.495013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.503985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d4210-bc15-4ed4-a5ca-5dc155852a7d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.549987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.551049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.551469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.551879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.559474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.561303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:52.575943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:52.577170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:52.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:52.580301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 366/743] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:52.581303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.623594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622afdb-babf-4e2c-9f4f-42719978c39f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.664018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.664700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.664982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.665305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.666045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:52.666353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.667858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.681104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 378/744] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:52.682147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.691062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.695517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a873-2510-42d1-bd79-067935742b73 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.730859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.731920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.732375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.732867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.744219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:52.747867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:52.753054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:52.754123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:52.755021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:52.757329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 367/745] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:52.758256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.801002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a138-4731-4840-ad41-a7b79e6a28dd None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.838197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.838915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.839210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.839485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.840449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:52.840677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.842339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.856175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 379/746] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:52.857180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.865465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bbc0-6417-4a82-bf39-f322c6dc14f3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.900917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:52.901994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:52.902414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:52.902822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:52.911277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:52.912920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:52.927972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:52.929108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:52.930010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:52.931551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 368/747] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:52.931652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:52.954406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:52.965750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162673-1980-4ae0-8a47-a364db2880ef None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:52.986563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:53.005788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.006472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.006754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.007027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.007883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:53.008277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.009833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.023533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 380/748] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:53.024408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.041150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458aa68-fedc-438a-8c0e-d8fb7d205cec None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.075645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.076902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.077436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.077907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/4bfe0c829ddb45cbb59b275e4c8349f4/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.080115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=4bfe0c829ddb45cbb59b275e4c8349f4, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.081822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.100074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 369/749] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:58:52 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/4bfe0c829ddb45cbb59b275e4c8349f4/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:58:53.101419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.134752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774671-9066-4c65-8f81-340b2cb65f4f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.174672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.175449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.175687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.175964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.176876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:53.177223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.178774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.193907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:53.200073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 381/750] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:53.210195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.223890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ef30b-0290-456b-8b59-ab868263a8b5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.266139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.267244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.267893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.268367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.281976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.283891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:53.304350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:53.305395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:53.306407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:53.306407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:53.306407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:53.306407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:53.306980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:53.308657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 370/751] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:53.314597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.422285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544bc97-07c4-4c51-ba88-c4b095840e4e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.436926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ccb98-1e7f-409a-9c4e-44122f863af5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.472756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:53.480198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.481181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.481658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.482122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.483176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:53.483633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.485208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.499153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 371/752] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:53.505326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.507499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.508218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.508508 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.508788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.652008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.653659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.685821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75cbe2-38db-4d85-9a84-7e6ea6a2cf14 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.712422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:53.757845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.758688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.759014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.759235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.772323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:53.774173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:53.790188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:53.791158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:53.792279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 372/753] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:53.797437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.843868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 382/754] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:58:53.847494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:53.898820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:53.959997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd069e-3b1f-42fd-9ae9-a30e6235114a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.977365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf588f-de10-469f-9e99-42576d94a84c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:53.997652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:53.998344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:53.998687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:53.998965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:53.999976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:54.000298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.001896 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0efaeb-59c5-45ad-a6a4-d283d6d99264 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.014648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.015800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.016288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.016791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.022217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 373/755] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:54.023944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94c970-2117-4a2c-a192-e56bd2af8cd2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.024229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94c970-2117-4a2c-a192-e56bd2af8cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.024505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94c970-2117-4a2c-a192-e56bd2af8cd2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.031454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 374/756] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:54.031454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94c970-2117-4a2c-a192-e56bd2af8cd2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.031876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.036693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.039598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-6ac01b36-bad3-4835-bded-2f81829cbf83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:54.063889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:54.064898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:54.065874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:54.065874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:54.065874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:54.065874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:54.067771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 383/757] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:54.069380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.069810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.070210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.092073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:54.094099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:54.182208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94c970-2117-4a2c-a192-e56bd2af8cd2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.189493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 384/758] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:54.189493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.208100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.241737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.242456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.242805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.243305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.330131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.332004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.333507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aeddc-6af2-462b-a025-5c43e1e1a8a9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.362644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.381567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.382530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.382955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.383370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.384691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:54.385184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.387377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.404375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 385/759] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:54.406236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.472215 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 375/760] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:58:54.473444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.487669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.518868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcba80-155b-4031-8645-85aa6578a4e5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.556761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.557627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.557908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.558185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.558845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.560261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:54.572898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:54.573930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:54.574793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 386/761] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:54.575683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.610557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2f799-bd65-4320-9ced-f1ce5ca4f723 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.625699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.650286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.651105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.651386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.652065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.660411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.661945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-2aafa916-f2b0-4618-9ad8-d868093d2182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:54.676675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:54.677596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:54.678485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 376/762] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:54.680764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ceb7-8ab8-42b5-a863-bd9268cefc82 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.680764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ceb7-8ab8-42b5-a863-bd9268cefc82 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.680764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ceb7-8ab8-42b5-a863-bd9268cefc82 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.681368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 377/763] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:54.682080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92ceb7-8ab8-42b5-a863-bd9268cefc82 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.698105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacaac0-053b-4922-ac9d-4b5bd45eda75 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.736301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.737271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.737631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.737906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.748640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.750110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.754838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:54.768814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:54.769963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:54.771740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:54.771740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:54.771740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:54.771740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:54.771740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 387/764] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:54.771740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.799672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92ceb7-8ab8-42b5-a863-bd9268cefc82 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.836733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.837446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.837731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.838096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.838725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:54.839033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.840406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459eb4-b066-4846-8abc-c5d76986cd3b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.849930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 378/765] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:54.849930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.849930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.849930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.864076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:54.865329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:54.873883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:54.881304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ef23-a4bc-40b8-9caa-ef248e357390 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:54.919207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:54.919880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:54.920166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:54.920858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:54.921749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:54.922064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:54.923708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:54.934174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 379/766] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:54.935968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:54.938198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 388/767] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:54.939201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.009210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.045561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ba9fc-820a-4ffc-9b1f-9d9173676133 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.050491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbfe44-88a7-40a6-a16e-d165f80278ac None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.082073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.083041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.083324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.083609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.084329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.084671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.086048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.087872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.088548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.088827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.089125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.089861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.090200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.096320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.096464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 389/768] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.096464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.108307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 380/769] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.109206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.123236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.208197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86689e8-ee60-4fc0-9dad-7e1fac668a09 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.211831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7864a-21ba-4dd9-ac9b-d051a23d2d1d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.235295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.244342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.245274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.245707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.246127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.247107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.247589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.248371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.249221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.249501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.249694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.249817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] PATH_INFO: `/v3/services/network` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.250419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.251994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.265050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 390/770] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/role_assignments?user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.265050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:55.266289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:55.267247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:58:55.268075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:55.268807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 381/771] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:55.269399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.386259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.397798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45bea9-79cc-487c-8df7-ad281637d9fb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.409529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4047c-942f-4268-b5c4-4bc2cd9267a1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.444199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.446658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.446658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.446658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.447336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.448079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.448888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.448888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.449639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] RBAC: Adding query filter params (interface=public, service_id=4382aba331e74b17803a0e4ebc2f3a6d, region_id=RegionOne) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.450019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.451477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.454078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.456392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.461341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 391/772] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/endpoints?service_id=4382aba331e74b17803a0e4ebc2f3a6d&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.462673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:55.479564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:55.481718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 382/773] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:55.483379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.544854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.598998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182bfac-2462-4eae-9fd6-478ee4e82cc9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.608940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891662-f431-4b7a-8d88-9d6e65888809 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.644238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.644948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.645402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.645752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.646539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] RBAC: Adding query filter params (name=network) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.646921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.648746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.649093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.649995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.650453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.650915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.651829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.653424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.659013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 392/774] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.659013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.664962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 383/775] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.666180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.676624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.776563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0cb1-6841-4969-9267-0ece02072d29 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.799605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446d648-ea49-42c0-a450-273cdc24b73d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.821431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:55.826074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.827073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.827537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.828523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.829958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.830712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.833455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70706f0a-0d5e-4ade-9375-fcef484e98df None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.846381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:55.848674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.849367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.856260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.856260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] RBAC: Adding query filter params (type=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:55.856260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:55.856260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:55.856923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 393/776] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.859357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a547-e8db-4400-b1cd-47c67bf893e1 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.860070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a547-e8db-4400-b1cd-47c67bf893e1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.860657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a547-e8db-4400-b1cd-47c67bf893e1 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.862704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 394/778] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:55.862838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 384/778] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:55.866865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.868783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:55.868783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:55.868783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:55.892015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:55.894159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:55.984689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282963-4cd0-4eaa-b0bc-caff0f24af2c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:55.988988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 395/779] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:55.990076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:55.992733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:56.027030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.028148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.028441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.029004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.029892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=fe9bf3adc64846df903b1646b4fe1a76) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:56.030372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:56.032418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:56.040441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 385/780] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/role_assignments?user.id=fe9bf3adc64846df903b1646b4fe1a76&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:56.041540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:56.125448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:56.181229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ea92-2730-4a50-b016-265ac7401f62 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:56.243279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.243919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.244148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.244418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.245255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] RBAC: Adding query filter params (interface=public, service_id=a19b878df5864168926781d6d4748a11, region_id=RegionOne) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:56.245571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:56.246987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:56.262530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 396/781] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:58:55 2022] GET /identity/v3/endpoints?service_id=a19b878df5864168926781d6d4748a11&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:56.264339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76bace-5a59-41fd-babe-6f2bd837ece7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:56.266856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:56.328616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.329506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.331610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.331903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.353461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:56.365316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:56.366421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:56.367605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:56.368869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 386/782] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:56.377257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:56.382188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:56.471170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bed0fe-aefa-4801-9ef9-c0f5df8160e9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:56.498257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:56.504362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b67d0-95d3-4609-a7a1-a3d8b50c74ff None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:56.542501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.543536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.543961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.544461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.545507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:56.545955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:56.547537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:56.552692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.553545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.554263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.554263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.555032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:56.556622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:56.558287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 387/783] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:56.562707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 397/784] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:58:56 2022] GET /identity/v3/services => generated 772 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:56.564623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:56.680422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb30ae-ee46-46d5-88bd-c3c307ab0761 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:56.717819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.718930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.719379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.719801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.732142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:56.733862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:56.753562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:56.754649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:56.755729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:56.755729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:56.755729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:56.755729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:56.757655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 388/785] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:56.763593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:56.922062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c537-2a01-45b8-8e64-8716d7357969 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:56.953118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:56.960260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:56.960942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:56.961270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:56.961546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:56.962279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:56.962587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:56.963967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:56.977812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 398/786] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:56.985246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:57.002906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:57.105626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3425f-bfcd-4065-98ed-ac72e6a097b6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:57.154633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:57.155735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:57.156163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:57.156601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:57.165335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:57.166995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:57.186021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:57.187200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:58:57.188343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:57.190801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 389/787] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:58:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:57.196608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:57.359752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87e39f-75b2-4833-a2f4-dd0370fb01fa None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:57.399759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:57.400455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:57.400741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:57.401038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:57.401915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:57.402227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:57.403688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b2a5-49a1-4894-8402-8f2031facd0c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:57.422752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 399/788] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:58:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:57.428192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:57.544426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:57.569628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfe131-19b5-47cf-ad80-120eb826b861 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:57.621263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:57.621863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:57.622147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:57.622422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:57.705610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:57.707092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:57.784495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:57.794877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776fc58-11e6-4b84-a2db-5509bcb5c4ef None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:57.795205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776fc58-11e6-4b84-a2db-5509bcb5c4ef None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:57.795512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776fc58-11e6-4b84-a2db-5509bcb5c4ef None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:57.797201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 400/789] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:57.802917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:57.803207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:57.803489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:57.821238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:57.822644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:57.826130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 390/790] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:58:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:58:57.832082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:57.875702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:57.905146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 401/791] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:57.930780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.043204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e209-dba1-4195-94c7-ae410761d630 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.051563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6449d-f589-492c-aba1-9a01cb90df55 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.090644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.091458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.091747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.092002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.105034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:58.114409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:58.115406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:58:58.116218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:58.116835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 402/792] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:58.122999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.158485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.159314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.159596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.159869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.171945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:58.191123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.192591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:58.226286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:58.228321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:58.230385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:58.230385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:58.230385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:58.230385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:58.237525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 391/793] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:58:58.238362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e63a1-39e5-4e1a-b8d3-7cbdc6225202 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.246042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.280637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.281447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.281741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.282021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.282936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:58.283264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.284783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.294229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 403/794] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:58:58.299594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:58.301238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.448416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:58.450566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57066-079b-4eb3-983e-f531466b7f4c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.464679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96cc93-0803-4bbf-93f1-119ce7bfe909 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.500219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.501171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.501447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.501853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.512148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.513171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.513453 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.513966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.514433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.514933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.515584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:58.516081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.518313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accefbd7-49d2-478e-a089-c328b2b5a65a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.531740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 392/795] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:58.533420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04e73-390c-4c5a-9ef5-9c82600aa256 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:58.533849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:58.534685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:58.535551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:58.535551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:58.535551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:58.535551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:58.535551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 404/796] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:58.536271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04e73-390c-4c5a-9ef5-9c82600aa256 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.536708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04e73-390c-4c5a-9ef5-9c82600aa256 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.538458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 393/797] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:58.542548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.543518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a04e73-390c-4c5a-9ef5-9c82600aa256 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.661656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920dd45-c860-4872-ab23-33c144ef743c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.667437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:58.691344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a04e73-390c-4c5a-9ef5-9c82600aa256 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.700182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.701228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.701740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.702216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.703158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:58.703668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.705415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec88dc-65f4-4d60-aae5-348e0b094c7a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.722923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 405/798] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:58.724630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9343-357d-4024-a3a4-fdec5ced6996 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.725274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9343-357d-4024-a3a4-fdec5ced6996 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.725780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9343-357d-4024-a3a4-fdec5ced6996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.733392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.734206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.734488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.734756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.742594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.744049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.744870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-554b9343-357d-4024-a3a4-fdec5ced6996 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:58.746166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-554b9343-357d-4024-a3a4-fdec5ced6996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:58.754968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:58:58.758910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:58.760079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 394/799] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:58.760956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.826578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 406/800] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:58.828340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4486-5fd4-4222-a5d9-369c692e0f2b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.828832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4486-5fd4-4222-a5d9-369c692e0f2b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.829329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4486-5fd4-4222-a5d9-369c692e0f2b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.830895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 407/801] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:58.831780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4486-5fd4-4222-a5d9-369c692e0f2b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:58.875919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ac0-1181-4ac5-a090-bf327b251826 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.912859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.913703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.914005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.914258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.921941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.923566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6f7c7377-ecc7-4adf-910f-c01905699b47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:58:58.939382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:58.940377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:58.941768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 395/802] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:58.942356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.942356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.942484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.946880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4486-5fd4-4222-a5d9-369c692e0f2b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:58.948598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:58.961419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:58.962658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:58.984472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:58.985591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:58.985873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:58.986603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:58.987400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:58.987716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:58.989211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.005549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 408/803] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.005549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.006440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.045067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 396/804] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:59.045067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.120873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16583c1-f681-469d-ad6a-61121ce8e318 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.145826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe52353-8e4b-4e2b-873d-a91b9eb6808f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.155924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.156753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.157055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.157336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.158035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.159414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:59.171679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:59.172629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:58:59.173596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 409/805] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:59.174626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.188130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.188827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.189174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.189450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.190460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:59.190772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.192250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.194512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.216198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 397/806] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.217208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.254471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.294016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83bfa5-e874-484f-a045-8116b0af6f7b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.325898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808494b-45ed-42f2-8d95-7863e378989a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.329369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.330077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.330357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.330630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.331468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=4bfe0c829ddb45cbb59b275e4c8349f4) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:59.331783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.333245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.339467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 410/807] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/role_assignments?user.id=4bfe0c829ddb45cbb59b275e4c8349f4&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.340067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.377789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.378932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.379431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.379872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.392621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:58:59.401881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:59.403074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:58:59.403919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:59.406859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 398/808] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:59.408187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.467371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf758-3eb1-4469-aa23-5b31105bffd8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.483894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.504183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.511605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.512630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.513138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.513669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.515517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:59.516132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.517912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.524214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 411/809] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.525417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.546175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cde3-ba16-44cb-af0a-afcab8b06d9f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.597335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.597713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.597992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.598264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.613363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.614842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:58:59.635185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:58:59.636177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:58:59.637130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:58:59.637130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:58:59.637130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:58:59.637130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:58:59.641178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 399/810] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:58:59.642733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.650214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdb697-3d40-4106-8edc-ac97b1c0e236 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.688543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.689320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.689800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.690334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.691096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:59.691500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.692855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c9ce-0485-4515-ba26-e06004a25b4a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.701265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 412/811] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.707481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b30ff0-0764-4f49-b1ca-6d56fc4dcdb9 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.707769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b30ff0-0764-4f49-b1ca-6d56fc4dcdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.708157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b30ff0-0764-4f49-b1ca-6d56fc4dcdb9 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.713270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 413/812] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:58:59.713270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b30ff0-0764-4f49-b1ca-6d56fc4dcdb9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.755575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a94da-e54b-4acb-b6b5-135e2dc4189f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.759619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.774258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:58:59.795577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.796420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.796420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.796622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.797392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:59.797713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.799154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.805254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 400/813] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.805893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.824043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b30ff0-0764-4f49-b1ca-6d56fc4dcdb9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.859950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.860619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.860935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.861513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.862254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:58:59.862562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.863969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ef51-76b5-4312-81ea-e7159133bbe6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:58:59.876679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 414/814] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:58:59.878068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.878413 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.878688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.896217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:58:59.897460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:58:59.924855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7186f4-9dd6-420b-b2f2-9e73d74d2562 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:58:59.964409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:58:59.965252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:58:59.965530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:58:59.965798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:58:59.977084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 415/815] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:58:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:58:59.977084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:58:59.988596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:58:59.990441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:00.009332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:00.010218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:00.011669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:00.011669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:00.011669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:00.011669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:00.011669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 401/816] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:00.011669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.035729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.037258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.099100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e48e-0667-4782-aa84-a2722e8d49c8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.118207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ae1a-15c3-45dd-a2a4-5bda70a363b4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.136443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.137144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.137424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.137693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.138710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.139812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.154065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.155012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.155354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.155666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.163866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.173124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 416/817] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:58:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:00.173368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.173540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:00.190341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:00.191306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:00.192196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 402/818] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:00.193154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.294668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.317800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2174f-55bb-476e-82e9-f9c2b68ea5ae None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.325896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.333716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd74a1-cedf-46cc-b778-d53d3ced4602 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.359778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.360724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.361230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.361583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.362421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:00.362798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.364314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.378327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 403/819] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:00.379330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.385945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.386772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.387052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.387328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.387998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.389443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:00.405298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:00.406375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:00.407505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 417/820] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:00.408549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.498498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd055b-1adf-4a59-8319-ac5ffb8914bb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.530031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6873-b70c-4cd2-a69e-c95f3b89a2ae None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.534084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.534768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.535048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.535320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.536133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:00.536441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.538056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.555592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.565185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 404/821] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:00.565185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.591376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.593121 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.593549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.593828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.602644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.604523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:00.623745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:00.624750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:00.626074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 418/822] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:00.626694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.659286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.697694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfca619-cac3-4ee7-9558-5160473f4531 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.735415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.736155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.736441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.736814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.737947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] RBAC: Adding query filter params (name=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:00.738055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.739459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.741178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81034013-f14a-4eee-afac-e59da87ced52 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.749183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 405/823] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:00.750120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.776686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.777968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.778477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.778958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/c3a96be7cce14b2e964bb6f3ff2d9b7a/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.781242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=c3a96be7cce14b2e964bb6f3ff2d9b7a, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.782984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.802308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 419/824] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:59:00 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/c3a96be7cce14b2e964bb6f3ff2d9b7a/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:59:00.803872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.822822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.868785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3f26-6bef-4f38-a893-8a4cab139734 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.908793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.909667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.909949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.910223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.911186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:00.911545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.913145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:00.914159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:00.937721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdee6e-a36c-4d28-a8e8-8644265a6890 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:00.941944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 406/825] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:00.944238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:00.994138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:00.995155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:00.995437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:00.995710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:00.996668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] RBAC: Adding query filter params (type=network) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:00.997041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:00.999221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:01.015774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 420/826] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:01.021924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:01.118209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1500a-590f-4cb3-8c1e-c78cc2e0adf2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:01.146111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:01.160663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:01.161513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.161794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.162073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.173241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:01.174817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:01.188445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277677c-31e8-4fda-a1e2-898d6952d18d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:01.194987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:01.196904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:01.198995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:01.198995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:01.198995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:01.198995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:01.205071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 407/827] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:01.205071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:01.224812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:01.225625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.225908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.226184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.226934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:01.228490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:01.251972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 421/828] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:59:01.315352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772858-0d13-4e9e-8050-6377b1912056 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:01.374546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:01.375249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.375534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.375810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.376614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:01.376933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:01.378437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:01.397225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 408/829] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:01.402790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:01.407220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:01.557791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ff5bb-aa95-4348-947f-e4a612753498 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:01.596136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:01.596959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.597274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.597550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.605655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:01.607237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:01.622204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:01.623138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:01.624030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 422/830] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:01.629396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:01.669506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:01.751875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635190-7754-4003-8ba5-beffa961c5c9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:01.789783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:01.790463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.790748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.791019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.791824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:01.792131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:01.793812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5d453-5ba2-4ec7-af67-e5638e8cc489 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:01.808855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 409/831] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:01.814351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:01.833432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3aa7-1743-4314-a5f7-289017a98567 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.833965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3aa7-1743-4314-a5f7-289017a98567 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.833965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3aa7-1743-4314-a5f7-289017a98567 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.835584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 410/832] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:01.840805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.841127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.841407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:01.858643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:01.859842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:01.893119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:01.935428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 411/833] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:01.946508 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaab0a-afc5-44e8-b4df-a5bbf6719c68 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:01.957931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:01.979965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:01.992956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:01.995351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:01.995855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:01.996358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/fe9bf3adc64846df903b1646b4fe1a76/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:02.015876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=fe9bf3adc64846df903b1646b4fe1a76, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:02.018605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:02.044955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 423/834] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:59:01 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/fe9bf3adc64846df903b1646b4fe1a76/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:59:02.086190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eee95-047a-48ed-88a2-cd1d1678db03 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:02.127586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:02.128814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:02.129326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:02.129824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:02.130713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:02.132380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:02.146945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:02.148290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:02.149154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:02.157203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 412/835] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jun 7 12:59:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:02.159079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:02.278782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed49f60-d839-4a89-86d6-85c282ce3c68 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:02.294810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:02.317694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:02.318371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:02.318653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:02.318925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:02.319642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:02.319947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:02.321362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4cf2a-49ac-46ed-b32b-a8a8849cec01 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:02.326395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 424/836] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:02.331869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:02.430854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:02.447496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7233e99-800a-411a-9948-1b845fe729d1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:02.483257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:02.483945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:02.484223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:02.484498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:02.485256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:02.485570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:02.487193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7f9c2-b969-4f40-a30b-8075ac3633d8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:02.497183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 413/837] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:02.739305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e196-2cce-4105-a3a8-3d20a76f4e94 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:02.740275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e196-2cce-4105-a3a8-3d20a76f4e94 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:02.740773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e196-2cce-4105-a3a8-3d20a76f4e94 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:02.742626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 425/838] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:02.748563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:02.749152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:02.749624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:02.766959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:02.768876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:02.837064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 414/839] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:02.860664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84e196-2cce-4105-a3a8-3d20a76f4e94 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:02.972116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84e196-2cce-4105-a3a8-3d20a76f4e94 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:03.015279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:03.016475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.016961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.017932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.018975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:03.020587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:03.034171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:03.035186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:03.036034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:03.038918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 426/840] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:03.045164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:03.127757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:03.151509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335f1a-319c-4568-b125-8b12377d0725 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:03.193314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:03.194019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.194303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.194578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.195343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:03.195651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:03.197245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250d36-bfd3-485f-a765-f9b1f5d03df4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:03.203313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 415/841] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:03.210154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:03.261393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:03.319863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e751b-3711-4e95-9a53-63b94841ea37 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:03.355995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:03.356676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.356962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.357310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.358010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:03.358326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:03.359856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3f775-065e-4fb3-b637-a235465a4a28 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:03.365982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 427/842] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:03.527867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19960ea1-f890-4d7d-957c-52e97c2d8a0e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.528250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19960ea1-f890-4d7d-957c-52e97c2d8a0e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.528424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19960ea1-f890-4d7d-957c-52e97c2d8a0e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.530098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 416/843] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:03.535924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.536214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.536491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.556191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:03.557610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:03.630867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 428/844] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:03.655330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19960ea1-f890-4d7d-957c-52e97c2d8a0e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:03.765250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19960ea1-f890-4d7d-957c-52e97c2d8a0e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:03.801406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:03.802223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.802506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.802780 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.813510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:03.821446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:03.822348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:03.823172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 417/845] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:03.828554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:03.863596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:03.931846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da726d-aa19-4e13-a7c8-747204154b05 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:03.966468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:03.967145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:03.967426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:03.967699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:03.968449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:03.968753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:03.970152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:03.979661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 429/846] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:03.985243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:03.988258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.094628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce709-f427-4b6d-b3fb-f9505a0d49b7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.128948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.129700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.129980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.130252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.141056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:04.142686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:04.161160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:04.162099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:04.162978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:04.162978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:04.162978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:04.162978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:04.162978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 418/847] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:04.168466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.265979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.271814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7145a0-4452-4214-8ab1-6c9d75c9029f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.307151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.307825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.308101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.308369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.309122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:04.309429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:04.310806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9e38-e44c-4ac5-abb3-afb7659c4bbe None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:04.322741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 430/848] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:04.328246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.339475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f74d9-2b87-49d4-ba11-0d08b69f890b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.339779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f74d9-2b87-49d4-ba11-0d08b69f890b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.340040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f74d9-2b87-49d4-ba11-0d08b69f890b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.341697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 431/849] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:04.348960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.349269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.349547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.368590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:04.369860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:04.393728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.447839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 432/850] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:04.450091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa856bd-a9c8-4522-936c-67b637ec5311 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.465294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.490596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.491683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.491962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.492235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.503478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:04.504946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:04.527627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:04.528671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 12:59:04.529674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:04.532610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 419/851] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:04.539260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.580906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.605572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab199-ea79-4f4f-9496-fcdf734bd921 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.643001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.643876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.644096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.644368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.655847 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:04.664407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:04.665732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 12:59:04.666562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:04.669731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db72ce-b209-41ba-8476-2b7ec99fc985 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.670418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 433/852] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:04.671273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.686544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.711440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.712329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.712704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.713150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.714103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:04.714515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:04.716379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:04.742507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 420/853] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:04.743646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.792027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60327f6-f6f8-41c5-9ffc-42b7bcb7a0c0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.838049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.839601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.840087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.840572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.841656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:04.842184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:04.843823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:04.857472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 434/854] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:04.859781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:04.865093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8c1d-20a6-4991-bddf-90a9f31ffa4a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.872028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.901952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9710194-5c0d-492a-aa3b-dda900ae24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:04.902589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9710194-5c0d-492a-aa3b-dda900ae24f1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:04.902872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9710194-5c0d-492a-aa3b-dda900ae24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:04.903200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9710194-5c0d-492a-aa3b-dda900ae24f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:04.947682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:04.968656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af5cb5-d9cd-42cb-ba94-aa539a052de6 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:04.975821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9710194-5c0d-492a-aa3b-dda900ae24f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:04.977303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9710194-5c0d-492a-aa3b-dda900ae24f1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.003941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.005029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.005378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.005655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.016432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.018331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-a5a83e0c-9c46-4ac5-bc54-93b9c9ace2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:05.037490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:05.038419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:05.039285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:05.039285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:05.039285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:05.039285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:05.039285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 435/855] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:05.040130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688310-b293-4b83-9c10-8f4b6d928c4f None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.040229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688310-b293-4b83-9c10-8f4b6d928c4f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.040470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688310-b293-4b83-9c10-8f4b6d928c4f None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.045185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 436/856] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:05.045185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688310-b293-4b83-9c10-8f4b6d928c4f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.087694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 421/857] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:05.089661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.090103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.090528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.109041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:05.110258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:05.114943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.164497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688310-b293-4b83-9c10-8f4b6d928c4f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.178377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 422/858] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:05.179219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.181721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.212415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.213511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.214067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.214672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.215499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:05.215813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.217218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.235061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 437/859] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:05.235061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.285219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5edc04-59a9-4278-9506-74f48cbf5fdd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.322204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.323017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.323293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.323568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.335120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.336546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.344442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb32ce-3a3e-45d3-871c-cfc06bcaec54 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:05.359269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:05.360354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:05.362445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:05.362445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:05.362445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:05.362445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:05.362445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 423/860] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:05.362445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.372343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.397006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.397704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.398370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.398646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.399388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.400802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.421151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 438/861] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:05 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:05.421151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.435234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.491834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600595bc-d04e-4dcb-876c-b5499fd2ac45 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.539796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7712f14-23f3-4037-9c8c-17cc2bb599d8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.543092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.544211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.544707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.545158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.555404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.557312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:05.580592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:05.581794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:05.582742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:05.583356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.583356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.583356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.583356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.583635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:05.583635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.583635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.586068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 424/862] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:05.593150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.599814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 439/863] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:05.600832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.644836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.725561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90c7c9-831b-4094-96e2-39b14906fcd9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.729598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e604bc-bbda-4a47-a0e8-4bfe8f6ce383 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.739987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.766316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.766550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.766996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.767106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.767341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.767505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.767651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.767739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.768553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:05.768861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.770576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5f820-ceba-4c1f-97e6-d58a74c0793c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.775533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.777049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.788370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 425/864] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:05.789939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58df9b-c7e8-4206-b3f7-e308615ac7ef None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.790349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58df9b-c7e8-4206-b3f7-e308615ac7ef None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.790755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58df9b-c7e8-4206-b3f7-e308615ac7ef None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:05.791762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:05.792602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:05.793525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:05.794377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 426/865] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:05.795230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58df9b-c7e8-4206-b3f7-e308615ac7ef None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.797915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 440/866] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:05.799003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:05.905249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:05.906301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58df9b-c7e8-4206-b3f7-e308615ac7ef None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.911658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a96766-8e6f-42b0-ac91-ca9fb400d299 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:05.943116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.944243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.944796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.945367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.946947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:05.947623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.947912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.948188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.949028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:05.949334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:05.950778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a6aa-37ff-4974-804a-ad2eee151d8b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:05.963659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 441/867] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:05.964964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:05.965271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:05.965551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:05.983812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:05.985251 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:05.991320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:06.027716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.029238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:06.063455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 442/868] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:05 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:06.064776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:06.143691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 427/869] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:05 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:06.144540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:06.168238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:06.185868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e4a1-4254-4cf0-b531-4d577523631e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:06.218129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:06.221134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:06.221840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:06.222119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:06.222380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:06.223218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:06.223526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.224966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:06.241139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 443/870] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:06 2022] GET /identity/v3/role_assignments?user.id=c3a96be7cce14b2e964bb6f3ff2d9b7a&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:06.241139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:06.268457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7376af-d399-43a6-b30b-5c84865aca81 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:06.310015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:06.310824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:06.311176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:06.311520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:06.312480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.314093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:06.336603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 428/871] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:06 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:06.383390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc423c-e9cd-4d3b-9e49-28a9a314463f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:06.429452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:06.430306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:06.430588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:06.430858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:06.443292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.444808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:06.453047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:06.466035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:06.467164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:06.468241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:06.468241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:06.468241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:06.468241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:06.470665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 444/872] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:06.476162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:06.607167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240326b-415b-4618-951e-f83d14a2a699 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:06.637292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:06.646519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:06.647551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:06.648288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:06.648570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:06.649365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:06.649678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.653521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:06.666150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 429/873] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:06.671484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:06.776929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf99f6-6d02-4025-ae5b-88872056aaf7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:06.812072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:06.812887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:06.813194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:06.813467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:06.820814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.822295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:06.836087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:06.837089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:06.838046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 445/874] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:06.846234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:06.950982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342caa1-7846-49b1-8e8f-a88935030118 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:06.988283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:06.988969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:06.989284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:06.989565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:06.990537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:06.990858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:06.992301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fef7-48cd-4d09-b421-a33737be6a6a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:07.005218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 430/875] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:07.010917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:07.077834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:07.121217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7a687-4c4d-4763-9def-d8e1cdc303bb None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:07.156283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:07.157364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:07.157969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:07.158486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:07.159530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=fe9bf3adc64846df903b1646b4fe1a76) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:07.160037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:07.161708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848fc33-7001-4add-a46f-e1151b0fe24e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:07.168639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 446/876] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:07 2022] GET /identity/v3/role_assignments?user.id=fe9bf3adc64846df903b1646b4fe1a76&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:07.790229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac746-42e8-422f-a3d0-9fe51d07a459 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:07.790751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac746-42e8-422f-a3d0-9fe51d07a459 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:07.790751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac746-42e8-422f-a3d0-9fe51d07a459 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:07.792381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 431/877] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:07.797742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:07.798032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:07.798306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:07.815344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:07.816528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:07.882752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 447/878] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:07.905635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbac746-42e8-422f-a3d0-9fe51d07a459 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:07.956836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:08.012753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbac746-42e8-422f-a3d0-9fe51d07a459 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:08.050148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:08.051266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.051701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.052116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.052920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:08.054454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:08.068312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:08.069541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:08.070519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:08.073140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 432/879] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jun 7 12:59:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:08.081054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:08.133577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:08.182793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020100-4d12-4fba-8e1a-d61b77d094d4 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:08.218906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:08.219586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.219868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.220150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.220901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:08.221244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:08.222800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:08.228096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 448/880] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:08.233793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:08.339516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc873e1-4e2f-4dc5-a161-bf9b1d3602e3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:08.353393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:08.383556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:08.384342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.384566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.384845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.385642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:08.385956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:08.387410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:08.393867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 433/881] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:08.399835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:08.516479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1db56-a84a-408d-9603-a15c961f5678 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:08.534504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:08.553908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:08.554585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.554870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.555144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.555950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] RBAC: Adding query filter params (interface=public, service_id=9e648b6c98cb4995800bde2d35c94362, region_id=RegionOne) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:08.556262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:08.557677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb0688-37d3-4c23-a96b-0479215238ad None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:08.563393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 449/882] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:59:08 2022] GET /identity/v3/endpoints?service_id=9e648b6c98cb4995800bde2d35c94362&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:08.568730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:08.687989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588352ca-3fbe-4ddd-9be2-00f617dfa08a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:08.723536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496136f-c41c-40b8-bf46-3437b1b7b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:08.724259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496136f-c41c-40b8-bf46-3437b1b7b38c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.724542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496136f-c41c-40b8-bf46-3437b1b7b38c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.724814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496136f-c41c-40b8-bf46-3437b1b7b38c None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.725549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496136f-c41c-40b8-bf46-3437b1b7b38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:08.726917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496136f-c41c-40b8-bf46-3437b1b7b38c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:08.730470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42642c1-5b41-4089-9b2c-1ca11eaf6d3c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.730979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42642c1-5b41-4089-9b2c-1ca11eaf6d3c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.731462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42642c1-5b41-4089-9b2c-1ca11eaf6d3c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.733210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 434/884] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:59:08 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 12:59:08.733434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 450/884] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:08.739454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.739775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.739998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.758905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:08.760120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:08.787702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63e4c-9ea3-4f8b-8651-fb2c7369fd4e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.788043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63e4c-9ea3-4f8b-8651-fb2c7369fd4e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.788266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63e4c-9ea3-4f8b-8651-fb2c7369fd4e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.789963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 451/885] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:08.795891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:08.796435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:08.796716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:08.802801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:08.822020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:08.823563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:08.844129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 435/886] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:08.866429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:08.915289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 452/887] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:08.939231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:08.990072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5d4c1-6f7b-4ce2-bcb6-d3080c14f367 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.034691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.035799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.036085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.036618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.037790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.039505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.055901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145edf58-31ec-4e06-9371-61334b2277b8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:09.060420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:09.061422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:09.062354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:09.066662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 436/888] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:09.067894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:09.073886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.097844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.099519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.100404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.100863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.101721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.103803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.116203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:09.122036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:09.124008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:09.125051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:09.136188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 453/889] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:09.138241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.195193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361077c-ac4b-4aba-aec9-4dc8fdfd32d4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.231259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.231848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.232223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.232591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.233460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:09.233886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.235421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.242959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 437/890] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:09.248551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.279026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481b5b2-827f-4ad5-bb73-22940bfb6eba None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.320283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.321750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.322510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.322993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.324402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:09.325219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.327261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.338672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 454/891] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:09.340544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.375904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:09.382176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217724d-c836-423a-9bae-6ab67718ae02 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.405466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:09.428593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.429306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.429587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.429859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.430888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:09.431219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.432834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.438936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 438/892] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:09.484318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85263d-634e-4bb0-8837-9e2b8a389bb1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.522421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.523463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.523746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.524019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.524740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:09.525069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.526474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613288b-a106-4aa8-99d8-85f33a785d09 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.532594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 455/893] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:09.541794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.586148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a85990-7ce6-40bf-876e-437a53cdfb4c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.586509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a85990-7ce6-40bf-876e-437a53cdfb4c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.586717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a85990-7ce6-40bf-876e-437a53cdfb4c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.588533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 456/894] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:09.594225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.594535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.594792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.617360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:09.618886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:09.675108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2266-e028-42c4-a935-2f08583de5cb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.712944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 457/895] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:09.723856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.724629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.724983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.725369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.726256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] RBAC: Adding query filter params (interface=public, service_id=3842b604cd734b08aa714e6903c5ae6a, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:09.726637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.728095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.736756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 439/896] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/endpoints?service_id=3842b604cd734b08aa714e6903c5ae6a&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:09.739065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.743749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:09.777865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:09.779938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:09.858412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24270ed-5d9c-44f0-a173-d547cc1a8538 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.872652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bd459-21f6-4100-986a-4e8cf641299d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:09.893552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.894640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.895327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.895751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.896586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:09.898920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:09.906854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 440/897] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 12:59:09.918966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:09.920357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:09.920898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:09.921424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:09.935914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:09.945839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:09.946867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:09.947694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:09.950687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 458/898] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:09.959552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:10.069829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:10.076173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a60a52-f32c-4597-98b8-741feae15ff1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:10.116252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:10.116952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:10.117271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:10.117542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:10.118315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:10.118613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:10.120004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:10.130017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 441/899] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 12:59:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:10.135581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:10.232140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:10.241268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a60e1-9d22-49ec-bb05-efdccea9d58e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:10.282422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:10.284030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:10.284322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:10.284601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:10.296100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:10.297703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:10.324915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:10.325892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:10.326770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:10.326770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:10.326770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:10.326770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:10.326770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 459/900] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:10.332451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:10.436304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f16c-a400-4651-82d7-428b0a74f279 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:10.471649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:10.472326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:10.472607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:10.472883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:10.473642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:10.473953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:10.475334 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:10.492306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 442/901] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:10.494114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:10.596317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5da89-7698-4638-831e-ee3fb6590f10 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:10.630355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:10.631195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:10.631482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:10.631755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:10.640503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:10.642075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:10.658893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:10.659892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:10.660806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:10.664976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 460/902] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 12:59:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:10.666406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:10.689790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:10.775231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acd70-f966-4a2d-bbaa-7ad4d1af84eb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:10.811790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:10.812524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:10.812813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:10.813122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:10.813988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:10.814451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:10.816156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:10.839804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 443/903] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jun 7 12:59:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:10.841252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:10.857421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:10.948460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3d2bd-3fda-441e-89c0-521a75b7a3a0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:10.982407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4cf65-4c69-4c21-bb2d-cb62148c4885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:10.983070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4cf65-4c69-4c21-bb2d-cb62148c4885 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:10.983353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4cf65-4c69-4c21-bb2d-cb62148c4885 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:10.983628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4cf65-4c69-4c21-bb2d-cb62148c4885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.055523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4cf65-4c69-4c21-bb2d-cb62148c4885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.057007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4cf65-4c69-4c21-bb2d-cb62148c4885 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.059706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.175318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 461/904] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:10 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:11.176693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.190474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678c2e-bb4a-4e14-ada1-f157c0d117a2 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.190809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678c2e-bb4a-4e14-ada1-f157c0d117a2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.191447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678c2e-bb4a-4e14-ada1-f157c0d117a2 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.193670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 462/905] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:11.199144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.199430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.199703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.217255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:11.218452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:11.293301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 463/906] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:11.301641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bd58-a44e-48db-8281-12d9061f5eb8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.304728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.311266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.344636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.345626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.345915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.346190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.347009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.362269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.364488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:11.389003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:11.389958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:11.390836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:11.390836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:11.390836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:11.390836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:11.393107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 444/907] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:11.397098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.427516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479455d-1469-4cfd-a28d-edd9d7f19094 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.464482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.465361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.465645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.465919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.466581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.468416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:11.481103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:11.482066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:11.482884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 464/908] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:11.490258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.512520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271402e-8118-4473-ba07-cd0b26ea5941 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.540665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.554346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.555023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.555301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.555571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.556632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:11.556632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.557996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.570545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 445/909] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:11.577249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.631577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.636138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7340-7818-4e73-ad97-37c5329108fc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.673200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.674404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.674884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.675371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.676274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:11.676816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.678482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.688834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554ae88-bc39-4c64-bb25-ca7d48685bee None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.689373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 465/910] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:11.690472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.722880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.723697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.723978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.724245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.731710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.733199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:11.748159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:11.749128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:11.750015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:11.753148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 446/911] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:11.755679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.800795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c967df-9e8d-4d1a-a287-3deb254c7f7b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.804156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.837836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.838904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.839391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.839859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.840782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:11.841325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.842897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e52bc-75b4-4159-9eea-6433b2fb16ca None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.853770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 466/912] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:11.855209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46895eac-7257-431c-a968-27b317a6c969 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.855499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46895eac-7257-431c-a968-27b317a6c969 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.855774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46895eac-7257-431c-a968-27b317a6c969 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.857215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 467/913] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:11.857920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46895eac-7257-431c-a968-27b317a6c969 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:11.867557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b3f0-d622-4b2a-8d5c-99371b989b86 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:11.889462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:11.905641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:11.906690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.907118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.907668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.908623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:11.908936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:11.910409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96c6d7-7cef-4da6-bb2b-fec50a36d8b2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:11.923977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 447/914] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:11.925358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:11.925650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:11.925984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:11.944816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:11.946007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:11.983502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46895eac-7257-431c-a968-27b317a6c969 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:12.021279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 448/915] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:12.025350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:12.032222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:12.033212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.033642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.034536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.035502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:12.037809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:12.058269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:12.069041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 468/916] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:12.069041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:12.158657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:12.167726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc0517-94ed-42ad-b9ff-6c8b38abfea2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:12.196015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e39a54-2a03-4d53-8b6d-9eb555558949 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:12.216852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:12.218001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.218505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.219067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.220047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] RBAC: Adding query filter params (role.id=542a6167f7124fabbd8380cc662360f6, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=fe9bf3adc64846df903b1646b4fe1a76) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:12.220478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:12.222514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012c3f-e702-409d-9c41-e24793252e21 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:12.230751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 449/917] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:12 2022] GET /identity/v3/role_assignments?user.id=fe9bf3adc64846df903b1646b4fe1a76&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=542a6167f7124fabbd8380cc662360f6 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:12.248313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aa21f-0ba1-4ba8-9d24-2857aa9ef3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:12.249049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aa21f-0ba1-4ba8-9d24-2857aa9ef3fb None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.249349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aa21f-0ba1-4ba8-9d24-2857aa9ef3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.249627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aa21f-0ba1-4ba8-9d24-2857aa9ef3fb None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.250400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aa21f-0ba1-4ba8-9d24-2857aa9ef3fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:12.252086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aa21f-0ba1-4ba8-9d24-2857aa9ef3fb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:12.271544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 469/918] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:12 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:12.278710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bf95-b1c7-4abf-a92c-e11f468dc0e6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.279040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bf95-b1c7-4abf-a92c-e11f468dc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.279275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bf95-b1c7-4abf-a92c-e11f468dc0e6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.281160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 450/919] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:12.287202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.287545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.287808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.309344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:12.310775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:12.404228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 470/920] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:12.428775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bf95-b1c7-4abf-a92c-e11f468dc0e6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:12.539283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:12.546415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bf95-b1c7-4abf-a92c-e11f468dc0e6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:12.588977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:12.589840 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.590119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.590389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.591050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:12.592545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:12.610151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:12.611494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:12.612715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 451/921] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:12.617735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:12.683125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:12.723119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88b33e-6d7f-4c4d-ab8e-83c2869d4544 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:12.758025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:12.758697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.758976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.759253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.759971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:12.760267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:12.761672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:12.766779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 471/922] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:12.772503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:12.879380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ccf3-6adb-4cfc-9166-17ac840e1276 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:12.916883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279f89-854b-4791-b506-849df14c209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:12.917590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279f89-854b-4791-b506-849df14c209f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:12.917873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279f89-854b-4791-b506-849df14c209f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:12.918146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279f89-854b-4791-b506-849df14c209f None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:12.918872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279f89-854b-4791-b506-849df14c209f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:12.919179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279f89-854b-4791-b506-849df14c209f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:12.920567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279f89-854b-4791-b506-849df14c209f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:12.926154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 452/923] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jun 7 12:59:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:12.931550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:13.032861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce558c-9f50-4716-bf5a-b26506ee6658 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:13.062821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:13.068171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d36ce-df30-42f2-9660-746f004c1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:13.068840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d36ce-df30-42f2-9660-746f004c1cce None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:13.069184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d36ce-df30-42f2-9660-746f004c1cce None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:13.069463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d36ce-df30-42f2-9660-746f004c1cce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:13.070261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d36ce-df30-42f2-9660-746f004c1cce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:13.071637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d36ce-df30-42f2-9660-746f004c1cce None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:13.093780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 472/924] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:14.514150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2aa9e-28cf-46ee-8869-4f3667e6049e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.514679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2aa9e-28cf-46ee-8869-4f3667e6049e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.514679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2aa9e-28cf-46ee-8869-4f3667e6049e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.516317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 453/925] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:14.521653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7ee9-fa4f-4a65-ac1b-1a0addad2a50 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.522464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7ee9-fa4f-4a65-ac1b-1a0addad2a50 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.523509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7ee9-fa4f-4a65-ac1b-1a0addad2a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.540942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e6fb7ee9-fa4f-4a65-ac1b-1a0addad2a50 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:14.542474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e6fb7ee9-fa4f-4a65-ac1b-1a0addad2a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:14.545605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1826d-5ca8-4e2a-8c61-244a9471ec10 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.545888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1826d-5ca8-4e2a-8c61-244a9471ec10 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.546171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1826d-5ca8-4e2a-8c61-244a9471ec10 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.547834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 454/926] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:14.552947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.553265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.553546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.572149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:14.573368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:14.591949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:14.632757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 473/927] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:14.634105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349c019-9059-4901-a2b9-b60093573235 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.634485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349c019-9059-4901-a2b9-b60093573235 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.634852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349c019-9059-4901-a2b9-b60093573235 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.636400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 474/928] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:14.646271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.646555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.646831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.657169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 455/929] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:14.662205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:14.670276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:14.671768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:14.745703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 475/930] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:14.746877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:14.780283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5482-e819-499d-9046-12c89316a7d8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:14.792734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:14.817631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:14.818439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.818804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.818989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.819656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:14.821051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:14.839113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:14.840178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:14.841049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 456/931] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:14.841839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:14.861626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:14.862659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56b56-6c5d-4593-b7d1-426ca2e9354b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:14.901214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:14.902309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.902598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.902873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.913838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:14.922155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:14.923225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:14.924152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 476/932] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jun 7 12:59:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:14.924950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:14.955678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294c26d-4609-4781-be26-827e1e6c8f06 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:14.990207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:14.991027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:14.991309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:14.991587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:14.992253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:14.993664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:15.006651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:15.007846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:15.008843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:15.012788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 457/933] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:15.013893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.035667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.039591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e1ca-5a58-487c-9f3b-7ca4b67fdd0a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.078402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.079379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.079873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.080145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.080870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.081209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.082732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.092264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 477/934] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:15.092264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.111219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.131124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4d8b-530a-4ecd-b2f2-d76a237aabcc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.167977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.168662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.168950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.169256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.170021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.170331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.171724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.180791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 458/935] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:15.186327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.199419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e01b-f5b8-4826-8973-efe193d45284 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.236740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.237583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.237868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.238137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.238846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.239152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.240527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.245572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 478/936] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:15.250924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.282534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.295004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91591b-fd40-446b-bbd7-50dce62f577f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.331105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.331788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.332070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.332342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.333484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.333796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.335496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.349046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 459/937] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:15.349046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.359556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.374950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657391a-4113-499c-9b22-87a33600c853 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.413930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.414758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.415036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.415305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.428693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.430427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-0f166a72-a2fd-4916-b11b-bccf79a2ed06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:15.450209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:15.451190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:15.452045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:15.452045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:15.452045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:15.452045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.452045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 479/938] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:15.452938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c655f2-c5e3-4028-a991-2dcb78021c71 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.453245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c655f2-c5e3-4028-a991-2dcb78021c71 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.453517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c655f2-c5e3-4028-a991-2dcb78021c71 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.457066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 480/939] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:15.460591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c655f2-c5e3-4028-a991-2dcb78021c71 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.487492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb018f-a017-48da-abc7-aec87f02a0f2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.529651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.530453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.530737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.531032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.531773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.532078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.533621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb27645-f2f9-4d8d-b044-4160f898ceac None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.544550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 460/940] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:15.544550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.544550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.544550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.558539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.560267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:15.561671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:15.589321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c655f2-c5e3-4028-a991-2dcb78021c71 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.640517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 461/941] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:15.640517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.640517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.646946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.647641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.648281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.648559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.649330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.649639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.651017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.664882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 481/942] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:15.665580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.751720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cac9-c2de-4be5-bc66-ced7dae4fc23 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.774094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d99fa-ded3-4c30-8bec-6035fffad722 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.788339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969646-651f-4f82-928c-32c511818f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.789043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969646-651f-4f82-928c-32c511818f37 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.789323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969646-651f-4f82-928c-32c511818f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.789598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969646-651f-4f82-928c-32c511818f37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.790398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969646-651f-4f82-928c-32c511818f37 None admin] RBAC: Adding query filter params (interface=public, service_id=ee21d39aab7b482d8e0bd7b406e18efd, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:15.790709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969646-651f-4f82-928c-32c511818f37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.792090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969646-651f-4f82-928c-32c511818f37 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.801839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 462/943] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/endpoints?service_id=ee21d39aab7b482d8e0bd7b406e18efd&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:15.801839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969646-651f-4f82-928c-32c511818f37 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.814975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.815665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.816034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.816373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.817179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.818638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.819999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING keystone.server.flask.common [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 07 12:59:15.829901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.837918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.sql.core [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 12:59:15.837918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 12:59:15.837918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [parameters: {'id': 'da8f1d40e0fa448da18b154af715f302', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 12:59:15.837918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id da8f1d40e0fa448da18b154af715f302.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id da8f1d40e0fa448da18b154af715f302. Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application conn.query(q) Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 12:59:15.845626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result.read() Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 07 12:59:15.846510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application next(self.gen) Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application yield resource Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application next(self.gen) Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise self.value Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application session.commit() Jun 07 12:59:15.847451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.session.flush() Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application compat.raise_( Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 12:59:15.848713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 12:59:15.849627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application conn.query(q) Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application result.read() Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 12:59:15.850406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [parameters: {'id': 'da8f1d40e0fa448da18b154af715f302', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.851273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:15.853268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id da8f1d40e0fa448da18b154af715f302. Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 482/944] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jun 7 12:59:15 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:15.854370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:15.882301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:15.924699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969646-651f-4f82-928c-32c511818f37 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.958471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b872c-88eb-46a7-9120-25fe35ccb790 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:15.960682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:15.961560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:15.961839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:15.962114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:15.969498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:15.971071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:15.987040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:15.987971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:15.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 463/945] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:15.989499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.000350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.001291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.001823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.001963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.002835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.004434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.013862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 483/946] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 12:59:16.014484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.091396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:16.134982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cba0a-2f70-4c23-9024-ad417b50e398 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.142268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c8c4d-05ee-4240-81d0-29c5a14fed0b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.168417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:16.181388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.182212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.182498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.182757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.191239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.192828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.196079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.197111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.197623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.198102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.199157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:16.199661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.201378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:16.208461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:16.209447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:16.210337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:16.214850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 464/947] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:16.215804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.226798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 484/948] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jun 7 12:59:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:16.232505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.331991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff665a92-3267-4851-b506-f7e31a6e4910 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.352828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d167-0a51-49fd-bc6c-f159a4457146 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.368639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.369792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.370373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.371018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.371886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:16.372286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.373958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.374772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:16.394889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.401039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.401233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 465/949] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:16.401673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.402775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.415476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.417149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:16.437805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:16.438894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:16.439887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:16.439887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:16.439887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:16.439887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:16.441702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 485/950] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:16.447746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.502381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:16.562711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b867ce2-e424-4d7f-9339-d0fe91a454d3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.615348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.616053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.616331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.616603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.617381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:16.617689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.619110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.637314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 466/951] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:16.640418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.743207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea6b1-a7e3-4baf-a6bc-58ff696a889e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.779004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.779808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.780087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.780359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.787445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.788894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:16.802511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:16.803451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:16.804369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 486/952] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:16.809795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:16.915237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee8afe-eb96-4b3a-9275-6b9fe242589d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:16.922601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:16.950931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:16.951645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:16.951929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:16.952243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:16.953061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:16.953370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:16.955073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ca641-cc17-4e76-9860-7afc3e4c141d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:16.968313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 467/953] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:16.974352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:17.006243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:17.085957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88c05-d56c-4e62-909d-44db60087c83 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:17.121474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656a114-cf68-462b-b343-c80de537f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:17.122667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a114-cf68-462b-b343-c80de537f1f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:17.123220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a114-cf68-462b-b343-c80de537f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:17.123634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a114-cf68-462b-b343-c80de537f1f1 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/fe9bf3adc64846df903b1646b4fe1a76/roles/542a6167f7124fabbd8380cc662360f6` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:17.126091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656a114-cf68-462b-b343-c80de537f1f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=fe9bf3adc64846df903b1646b4fe1a76, role_id=542a6167f7124fabbd8380cc662360f6)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:17.128033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656a114-cf68-462b-b343-c80de537f1f1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:17.146078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 487/954] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:59:16 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/fe9bf3adc64846df903b1646b4fe1a76/roles/542a6167f7124fabbd8380cc662360f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:59:17.670951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b92131-164c-4436-9774-01849f883d53 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:17.671477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b92131-164c-4436-9774-01849f883d53 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:17.671477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b92131-164c-4436-9774-01849f883d53 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:17.672996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 468/955] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:17.678723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec42d-6483-42ca-bc0b-cdecb2690e6f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:17.679530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec42d-6483-42ca-bc0b-cdecb2690e6f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:17.680027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec42d-6483-42ca-bc0b-cdecb2690e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:17.698693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-459ec42d-6483-42ca-bc0b-cdecb2690e6f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:17.700593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-459ec42d-6483-42ca-bc0b-cdecb2690e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:17.777965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 488/956] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:17.801208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b92131-164c-4436-9774-01849f883d53 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:17.908179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b92131-164c-4436-9774-01849f883d53 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:17.943883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699883a-f829-4d0c-89cc-e09cf3851a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:17.944950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699883a-f829-4d0c-89cc-e09cf3851a80 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:17.945479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699883a-f829-4d0c-89cc-e09cf3851a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:17.945953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699883a-f829-4d0c-89cc-e09cf3851a80 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:17.946912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699883a-f829-4d0c-89cc-e09cf3851a80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:17.948496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699883a-f829-4d0c-89cc-e09cf3851a80 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:17.965089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 469/957] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:17 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:18.337903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b092d2-d7ed-4e7d-8a5a-0ff86afa1908 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:18.338100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b092d2-d7ed-4e7d-8a5a-0ff86afa1908 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:18.338370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b092d2-d7ed-4e7d-8a5a-0ff86afa1908 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:18.340040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 489/958] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:18.345861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:18.346180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:18.346447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:18.364242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:18.365476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:18.392360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:18.448692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 470/959] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:18.472952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b092d2-d7ed-4e7d-8a5a-0ff86afa1908 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:18.498717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:18.588355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b092d2-d7ed-4e7d-8a5a-0ff86afa1908 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:18.623000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:18.623883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:18.624475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:18.624786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:18.625495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:18.627013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:18.639488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:18.640550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:18.641455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 490/960] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:18.646956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:18.781589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50c3a-943b-4a35-9985-fe42a9620ed5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:18.830086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:18.831183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:18.831668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:18.832184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:18.833139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:18.833652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:18.835248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eaba7-033f-45d0-9cdb-6692ee202b9c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:18.841540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 471/961] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:18.851466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:18.926061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ee75-cd9e-4e1d-bd14-5d09a5329c32 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:18.926393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ee75-cd9e-4e1d-bd14-5d09a5329c32 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:18.926652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ee75-cd9e-4e1d-bd14-5d09a5329c32 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:18.929061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 472/962] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:18.939760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:18.940147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:18.940430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:18.964383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:18.972815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:18.974072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:18.995486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424965f-6696-454e-a02c-c733c2eeb56d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.005386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:19.063351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:19.064081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.064416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.064895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.065849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:19.066163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:19.067553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:19.082754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 491/963] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:19.084825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:19.106504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 473/964] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:19.125781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:19.240849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d17cd-5997-4fa0-8346-ee17aa46dace None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.285926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:19.288381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.288923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.290434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.293186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:19.294791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:19.305088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8029-2a03-4f5c-8a9a-0b11a9441536 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.351703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:19.352454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.352742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.353106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.353808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:19.354644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 492/965] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:19.355560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:19.357065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING keystone.server.flask.common [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 07 12:59:19.372359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.sql.core [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 12:59:19.372359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 12:59:19.372359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [parameters: {'user_id': '9988ae51cf3a4a21840b480903e4eed2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 12:59:19.372359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80515) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a1d5df9a-24a1-4ebf-994e-fef300d6b56b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application conn.query(q) Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application result.read() Jun 07 12:59:19.393149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 12:59:19.394132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application next(self.gen) Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application yield resource Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application next(self.gen) Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise self.value Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application session.commit() Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 12:59:19.395589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.session.flush() Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application compat.raise_( Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 12:59:19.396694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 12:59:19.397599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application conn.query(q) Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application result.read() Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 12:59:19.399783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [parameters: {'user_id': '9988ae51cf3a4a21840b480903e4eed2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:19.403030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 07 12:59:19.404863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:19.407406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 474/966] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jun 7 12:59:19 2022] POST /identity/v3/users => generated 160 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:19.418075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:19.418075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:19.509419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36d411-766f-4892-9cf5-79fe62c03668 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.509796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36d411-766f-4892-9cf5-79fe62c03668 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.509950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36d411-766f-4892-9cf5-79fe62c03668 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.516746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9786a05-3483-4967-b184-062b1d2bcb3f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.518679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 475/967] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:19.520132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.520364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.520642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.529036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:19.542391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:19.543875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:19.560153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:19.561420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.561854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.562259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.575244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:19.577147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:19.596090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:19.597195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 12:59:19.598310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:19.599525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 493/968] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:59:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:19.604160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:19.635227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 476/969] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:19.660522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:19.684527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:19.725870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ad9a0-989d-4896-b80f-95dfac0b65cd None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.761569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:19.762261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.762547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.762820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.763647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:19.763953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:19.765658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:19.771627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a288b6-b0e2-49c2-9bef-09a4390cb0a0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.807723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:19.809361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:19.809865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:19.810342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:19.813276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:19.813435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 494/970] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jun 7 12:59:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:19.825913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:19.835229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:19.836236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:19.837218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:19.840404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 477/971] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jun 7 12:59:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:19.847264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:19.962151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ab921-a144-42ae-a577-079390df60ca None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:19.991574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.016300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.016300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.016300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.016300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.016897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:20.017120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.018746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.033173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 495/972] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 12:59:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:20.035105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.141938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1989-179f-4392-91f3-edbb014710d0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.177515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.178333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.178614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.178891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.190519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.192143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c8579b63-30e1-4eb7-bfcc-a866c8bde0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:20.210140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:20.211076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:20.212038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:20.212038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:20.212038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:20.212038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:20.212038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 478/973] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:20.217283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.318898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f509b-dfc5-4cd9-ada4-c3275988feda None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.326227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b8fb-e60f-439c-8cf4-514fecce42d6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.326529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b8fb-e60f-439c-8cf4-514fecce42d6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.326811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b8fb-e60f-439c-8cf4-514fecce42d6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.328367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 479/974] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:20.333520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.334097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.334097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.351173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:20.352408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:20.354348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.355017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.355300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.355569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.356292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:20.356597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.357993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.371735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 496/975] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:20.377455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.400191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.426169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.429440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 480/976] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:20.452042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.483623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e6a03-2ec0-4ef8-bff1-09a1580af266 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.521068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.522368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.523182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.523721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.533131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.535251 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.553885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c0229-9e42-4dd0-9ac0-1cc43057d92a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:20.557058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:20.558139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 12:59:20.559258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:20.561920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 497/977] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:20.567222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.591319 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.592128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.592407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.592675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.593373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.594761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:20.610642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:20.611662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:20.612494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 481/978] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:20.618513 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.663993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.676074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06529ae-be64-4955-8202-f6eba821cef9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.678558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.712470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.713183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.713467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.713748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.714771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:20.714918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.716350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.730938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408d7c-8ac5-4d7f-ad8b-63639ac70380 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.736153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 498/979] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:20.741640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.768431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.769168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.769451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.769729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.770444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:20.770749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.772160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.777623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 482/980] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:20.783306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.854572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4d3d-ffa3-4981-b223-9dde317e3bca None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.890895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.891554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.891833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.892111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.892554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024b45c-a7b9-495c-80ef-d861eb129d9c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:20.896422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.923861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:20.936560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:20.937383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:20.937634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:20.937909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:20.938621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:20.938926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.940471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:20.950121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 483/981] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:20.951102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:20.966015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:20.967483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.056926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf334686-438b-419d-bcb2-2963dafd5a00 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.066369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 499/982] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 12:59:21.072029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.092758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.093456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.093726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.094004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.094812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] RBAC: Adding query filter params (interface=public, service_id=8cffa32457e94177867251070b3d786d, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:21.095131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.096643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.101943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 484/983] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:59:20 2022] GET /identity/v3/endpoints?service_id=8cffa32457e94177867251070b3d786d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:21.107442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.141335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:21.144412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:21.182582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec77825-6d5f-4182-9ee4-87ec45013cc7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.218519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.219328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.219609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.219882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.225492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1c74-9e0f-42a8-8005-bd151896cc1d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.231168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.232634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:21.251108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:21.252103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:21.257919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:21.257919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:21.257919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:21.257919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:21.257919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 500/984] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:21.258582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.271032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.272029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.272293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.272720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.273848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.275235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.281999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 485/985] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 12:59:21.372097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc883339-c8b6-4406-9696-b559fff6149a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.389943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:21.415231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.415944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.416230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.416506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.417305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:21.417621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.419111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.433061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 501/986] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:21.439255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.551302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:21.558229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af7d8-107f-4f26-abbd-7755f79ee523 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.599834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.600740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.601266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.601455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.612684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.614270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d97dc98a-6faa-43aa-affe-1990464e7e6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:21.636293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:21.637437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:21.638359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:21.644589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 486/987] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:21.646152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.753651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6de2e-07e7-40fa-9d0e-975f5ed91a20 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.762597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904e14-a872-4ac1-93b6-51ab7ee78c08 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.762884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904e14-a872-4ac1-93b6-51ab7ee78c08 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.763163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904e14-a872-4ac1-93b6-51ab7ee78c08 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.764677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 487/988] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:21.769671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.769974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.770246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.791022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:21.792558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:21.794050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.794723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.795007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.795275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.796069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:21.796376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.797840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.810513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 502/989] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:21.816660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.851841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:21.872978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 488/990] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:21.895292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:21.932962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48fc93-fa8b-4714-87a4-035a0b233334 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:21.967951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:21.968607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:21.968890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:21.969197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:21.970048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] RBAC: Adding query filter params (role.id=542a6167f7124fabbd8380cc662360f6, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=fe9bf3adc64846df903b1646b4fe1a76) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:21.970469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:21.972127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:21.978644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 503/991] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/role_assignments?user.id=fe9bf3adc64846df903b1646b4fe1a76&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=542a6167f7124fabbd8380cc662360f6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:22.006088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:22.025146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d36388-1dd4-4baf-8003-14e06d49db39 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:22.066662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:22.067506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:22.067790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:22.068066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:22.068745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:22.070301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:22.084253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:22.085633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:22.086467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 489/992] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:22.091790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:22.201164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:22.206605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3a45-7e42-4c01-bb04-2841791dba05 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:22.241642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:22.242578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:22.243010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:22.243423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:22.244267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:22.244732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:22.246304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:22.252077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 504/993] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:22.258794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:22.363775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580c2a-97c9-4b3d-afce-9af56bfdd8b6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:22.400104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:22.400786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:22.401090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:22.401364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:22.402077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:22.402380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:22.403750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:22.409118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 490/994] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:22.414735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:22.520191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243565b-732b-4623-94ad-2fae1c2614a2 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:22.554753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c28e3-c654-425f-b854-2143852497de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:22.555419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c28e3-c654-425f-b854-2143852497de None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:22.555697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c28e3-c654-425f-b854-2143852497de None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:22.555968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c28e3-c654-425f-b854-2143852497de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:22.556769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c28e3-c654-425f-b854-2143852497de None admin] RBAC: Adding query filter params (interface=admin, service_id=ee21d39aab7b482d8e0bd7b406e18efd, region_id=RegionOne) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:22.557107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c28e3-c654-425f-b854-2143852497de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:22.558487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c28e3-c654-425f-b854-2143852497de None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:22.564147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 505/995] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Jun 7 12:59:22 2022] GET /identity/v3/endpoints?service_id=ee21d39aab7b482d8e0bd7b406e18efd&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:22.569847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:22.587459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:22.683879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321439e-90f8-4c7d-9086-779182b168fa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:22.719042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21591fae-a3bd-4474-937c-577250b22a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:22.719718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21591fae-a3bd-4474-937c-577250b22a75 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:22.719999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21591fae-a3bd-4474-937c-577250b22a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:22.720287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21591fae-a3bd-4474-937c-577250b22a75 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:22.720971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21591fae-a3bd-4474-937c-577250b22a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:22.722422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21591fae-a3bd-4474-937c-577250b22a75 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:22.728852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 491/996] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:59:22 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 12:59:23.554420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6ecdb-05f6-4531-afbc-9fe37e8f4604 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:23.554970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6ecdb-05f6-4531-afbc-9fe37e8f4604 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:23.554970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6ecdb-05f6-4531-afbc-9fe37e8f4604 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:23.556320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 506/997] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:23.562002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:23.562426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:23.562501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:23.582928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:23.584102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:23.657795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 492/998] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:23.682518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6ecdb-05f6-4531-afbc-9fe37e8f4604 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:23.723472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:23.809485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6ecdb-05f6-4531-afbc-9fe37e8f4604 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:23.844025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:23.844841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:23.845170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:23.845552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:23.846513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:23.847918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:23.859768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:23.860741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 12:59:23.862011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:23.865339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 507/999] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:23.867147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:23.878536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:23.980445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5d439-ccc4-48ca-a945-baabc108d659 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:24.015725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:24.016402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.016678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.016953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.017722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:24.018025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:24.019395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:24.024886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 493/1000] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:24.030561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:24.129634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:24.140539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e33d-88dc-434e-af7e-4c1ec0ea2975 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:24.176729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:24.177447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.177727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.177971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.178692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:24.178993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:24.180428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c19c09-2a90-4e8c-b11e-c433354a5637 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:24.185748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 508/1001] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jun 7 12:59:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:24.191320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:24.260748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c66fb-d5c0-409a-bb4d-ab09fffdf09c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.261027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c66fb-d5c0-409a-bb4d-ab09fffdf09c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.261334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c66fb-d5c0-409a-bb4d-ab09fffdf09c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.262977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 509/1002] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:24.263935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:24.268065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.268347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.268617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.285864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:24.287030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:24.296402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90c3f-0f04-4426-8880-9f9368291e01 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:24.330856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:24.331524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.331827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.332085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.332844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:24.334245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:24.356877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 510/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:24.362820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 494/1004] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:59:24.380300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:24.489274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:24.508671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ebcd4-4031-43db-a227-f3506c5d7724 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:24.553659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:24.554474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.555010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.555010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] PATH_INFO: `/v3/services/image` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.555662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:24.557060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:24.569445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:24.570472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:24.571312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 511/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jun 7 12:59:24 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:24.579881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:24.692914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ceebb-0d14-4a8f-9cbb-748f99dab67e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:24.719755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:24.729427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:24.730115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.730393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.730670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.731390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] RBAC: Adding query filter params (name=image) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:24.731697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:24.733081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce248-759b-455a-b1e7-ad3df96b5483 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:24.738248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 495/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:24.743905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:24.855412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d2570-f426-42b5-91d7-323dc485e42b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:24.889832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:24.890502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:24.890776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:24.891047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:24.891756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] RBAC: Adding query filter params (type=image) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:24.892081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:24.893481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcf764-eaa9-47b2-9e1d-aed3327ce235 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:24.898587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 512/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:25.103464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4cdfc-7494-43cc-b275-cdff793dfc0b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:25.103771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4cdfc-7494-43cc-b275-cdff793dfc0b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:25.104051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4cdfc-7494-43cc-b275-cdff793dfc0b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:25.105490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 496/1008] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:25.111827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:25.112128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:25.112412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:25.130259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:25.131456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:25.133722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:25.209062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 513/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:25 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:25.231602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4cdfc-7494-43cc-b275-cdff793dfc0b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:25.341337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4cdfc-7494-43cc-b275-cdff793dfc0b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:25.377603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:25.378465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:25.378751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:25.379018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:25.379732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:25.381118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:25.393782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:25.394776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:25.401605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 497/1010] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jun 7 12:59:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:25.402518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:25.503874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c047e3-26b3-4be2-b2a0-03016775264f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:25.544237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:25.545465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:25.546300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:25.546581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:25.547291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:25.547593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:25.549059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:25.557219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 514/1011] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:25.560498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:25.626353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:25.674352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076542-cebc-442c-ba0c-733619cdef1b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:25.710641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:25.711320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:25.711605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:25.711873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:25.712594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:25.712902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:25.714300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b251c2-805f-48ae-aea7-147102cd55db None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:25.719642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 498/1012] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jun 7 12:59:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:25.725590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:25.728535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:25.829692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bf597-95cb-4cd2-8d9b-0a77c012ec2e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:25.865959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5b78a-d5fe-4f19-899e-ab4cf37ac7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:25.866629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5b78a-d5fe-4f19-899e-ab4cf37ac7e5 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:25.866912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5b78a-d5fe-4f19-899e-ab4cf37ac7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:25.867185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5b78a-d5fe-4f19-899e-ab4cf37ac7e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:25.867934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5b78a-d5fe-4f19-899e-ab4cf37ac7e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:25.869352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5b78a-d5fe-4f19-899e-ab4cf37ac7e5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:25.886757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 515/1013] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:26.724329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edf690-318d-423c-8bda-d294d5339205 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:26.724915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edf690-318d-423c-8bda-d294d5339205 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:26.724915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edf690-318d-423c-8bda-d294d5339205 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:26.726437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 499/1014] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:26.731663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:26.732076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:26.732247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:26.749398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:26.750572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:26.812768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:26.832942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 516/1015] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:26 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:26.856656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edf690-318d-423c-8bda-d294d5339205 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:26.970136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edf690-318d-423c-8bda-d294d5339205 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:26.990971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:27.006497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16175b-fca3-475f-86db-ccadd763ed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.007328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16175b-fca3-475f-86db-ccadd763ed81 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.007609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16175b-fca3-475f-86db-ccadd763ed81 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.007883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16175b-fca3-475f-86db-ccadd763ed81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.019562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16175b-fca3-475f-86db-ccadd763ed81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8d16175b-fca3-475f-86db-ccadd763ed81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:27.028332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:27.029363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:27.035501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 500/1016] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jun 7 12:59:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:27.037781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.138254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822710f-55c5-4227-adb0-8a5c6657e4b3 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:27.148220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f890-9241-4a3c-a44d-4a1ab765526d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.148498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f890-9241-4a3c-a44d-4a1ab765526d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.148750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f890-9241-4a3c-a44d-4a1ab765526d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.153060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 501/1017] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:27.155485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.155983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.156458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.173712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:27.174979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:27.177789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.178477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.178762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.179036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.179798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:27.180106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:27.181535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:27.190692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 517/1018] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 12:59:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:27.196804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.250889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 502/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:27 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:27.252157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:27.275297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.307099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcf0f4-509b-49dc-ad07-ecc5b2ed2396 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:27.344719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.345964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.346503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.346777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.357709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:27.359379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:27.377866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc14f64-a410-498f-bad2-dc9b51bc79cf None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:27.381039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:27.381893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:27.387655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:27.387655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:27.387655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:27.387655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:27.387655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 518/1020] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:27.388350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.389377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:27.413930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.414715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.414994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.415264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.415989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:27.417420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:27.437075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 503/1021] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:27 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 12:59:27.504717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527036d-efb2-4068-aa42-1f2e7b0655f4 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:27.506770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:27.550597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.551281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.551566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.551833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.552631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:27.552942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:27.554392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:27.569061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 519/1022] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:27.577078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.693867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4ce6e-f59a-4d0c-9003-2c689bc8e8fd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:27.727629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.728604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.728889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.729191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.737206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:27.738646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:27.752971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:27.753968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:27.754973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 504/1023] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:59:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:27.761724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.873481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3ebaf-45b8-4edc-a4fb-3561f67f70f8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:27.913440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:27.913440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:27.913440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:27.913440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:27.913968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:27.913968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:27.913968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799dc34-c10a-49f3-8565-2c2ea899c6aa None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:27.932296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 520/1024] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:59:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:27.937954 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:27.972792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.049995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5863-b729-465f-a952-c64442aa54a5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.085396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.086059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.086343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.086618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.156220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.157744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.176614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f460b-7132-4c77-a6f4-6f67c9e7997c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.176901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f460b-7132-4c77-a6f4-6f67c9e7997c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.177205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f460b-7132-4c77-a6f4-6f67c9e7997c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.178729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 521/1025] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:28.183712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.184009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.184280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.188151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.202082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:28.203457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:28.215854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.273342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 505/1026] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:28.275373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:28.283998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 522/1027] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:28.307101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:28.380689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69fc06-8511-4f12-8bf6-772d75bde73c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.407580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd83f-0cba-4717-93bc-3673704e020a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.410040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.416368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.417196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.417475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.417746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.428296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.429766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.443843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.444667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.444935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.445235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.446402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:28.447535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:28.448400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:28.454377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:28.454377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:28.454377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:28.454377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:28.454680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.454755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 506/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:28.454822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 523/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:28.454888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:28.455410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:28.471757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.559296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d290-8d11-494e-aff7-5e17c4d97e2b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.560934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea954ff-1ebc-4e89-abcc-01e4dddd6d6e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.601158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.601863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.602149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.602247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.602485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.602878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.603213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.603307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:28.603528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.606892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.607029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.607124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.607197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.619937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 507/1030] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:28.625434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:28.645045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 524/1031] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:28 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:28.685751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.753230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaff9f-2e1b-4f19-8068-ba47def09991 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.792285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.793143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.793418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.793652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.801934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.803405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:28.819567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:28.820511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:28.826419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 508/1032] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:28.828928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:28.894136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:28.930586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e983e-c0a9-4d47-bc99-dc3e2ec73ad9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:28.965987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:28.966645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:28.966925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:28.967192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:28.967987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:28.968287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:28.969741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db752dd-5609-42de-92b4-c1ca3fb8ecb9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:28.983140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 525/1033] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:28.989164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:29.094269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb47e8-36a1-4a96-a18d-56223497ad14 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:29.095952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:29.131434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:29.132099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:29.132428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:29.132703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:29.133569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] RBAC: Adding query filter params (role.id=542a6167f7124fabbd8380cc662360f6, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=4bfe0c829ddb45cbb59b275e4c8349f4) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:29.133879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:29.135348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0013872-5aca-4b79-bcd2-ad6fc67ac321 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:29.141263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 509/1034] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:28 2022] GET /identity/v3/role_assignments?user.id=4bfe0c829ddb45cbb59b275e4c8349f4&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=542a6167f7124fabbd8380cc662360f6 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:29.703648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b1c1-2539-4db5-a0b4-0f73258feaf6 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:29.703984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b1c1-2539-4db5-a0b4-0f73258feaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:29.704213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b1c1-2539-4db5-a0b4-0f73258feaf6 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:29.706042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 526/1035] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:29.711466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:29.711761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:29.712036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:29.729769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:29.730965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:29.809079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 510/1036] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:29.828170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b1c1-2539-4db5-a0b4-0f73258feaf6 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:29.935357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b1c1-2539-4db5-a0b4-0f73258feaf6 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:29.961411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:29.972189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:29.972995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:29.973305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:29.973588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] PATH_INFO: `/v3/services/image` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:29.974232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:29.975622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:29.987435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:29.988472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:29.989369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:29.993342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 527/1037] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jun 7 12:59:29 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:29.994782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:30.094213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:30.101420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289e153-b353-4af2-ad25-4380a689ed3f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:30.136341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:30.137042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:30.137330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:30.137601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:30.138323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] RBAC: Adding query filter params (name=image) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:30.138637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:30.140079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:30.145349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 511/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:30.151285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:30.257844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca510-6d10-49bc-b67a-d87f2dde1f3c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:30.292394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:30.293105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:30.293392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:30.293670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:30.294392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:30.294705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:30.296092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:30.305081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 528/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:30.307823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:30.420286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e82af-eba1-4173-9535-3fefe74616bf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:30.454953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:30.455619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:30.455900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:30.456174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:30.456983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] RBAC: Adding query filter params (interface=public, service_id=608de0cefc884ca4b6881c4ec3868a50, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:30.457324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:30.458694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f849-ca92-4a9c-b995-975b9238571e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:30.464193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 512/1040] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 12:59:30 2022] GET /identity/v3/endpoints?service_id=608de0cefc884ca4b6881c4ec3868a50&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:30.469569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:30.526324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:30.572328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a62685-64d2-4007-a149-781e5a8cc4b9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:30.620443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6cb88-8ae2-4d9c-b945-a6a2c96d1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:30.621175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6cb88-8ae2-4d9c-b945-a6a2c96d1993 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:30.621458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6cb88-8ae2-4d9c-b945-a6a2c96d1993 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:30.621728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6cb88-8ae2-4d9c-b945-a6a2c96d1993 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:30.622426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6cb88-8ae2-4d9c-b945-a6a2c96d1993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:30.623820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6cb88-8ae2-4d9c-b945-a6a2c96d1993 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:30.637052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 529/1041] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 12:59:30 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 12:59:30.931632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5e30-09b1-4f1f-ae01-8cd9add26c6c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:30.932183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5e30-09b1-4f1f-ae01-8cd9add26c6c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:30.932183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5e30-09b1-4f1f-ae01-8cd9add26c6c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:30.933770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 513/1042] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:30.939213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:30.939669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:30.939940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:30.958318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:30.959545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:31.041106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 530/1043] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:31.061651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f5e30-09b1-4f1f-ae01-8cd9add26c6c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:31.089448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:31.168564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f5e30-09b1-4f1f-ae01-8cd9add26c6c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:31.204068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cba26-b3d2-4b59-8891-dc0e5138d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:31.204884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cba26-b3d2-4b59-8891-dc0e5138d104 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.205275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cba26-b3d2-4b59-8891-dc0e5138d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.205442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cba26-b3d2-4b59-8891-dc0e5138d104 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.206682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cba26-b3d2-4b59-8891-dc0e5138d104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:31.208123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cba26-b3d2-4b59-8891-dc0e5138d104 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:31.209951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 514/1044] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:31.215634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:31.264980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:31.319148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddd68e-370f-4c8c-8410-7d2cbdb87037 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:31.351081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec501e0-860d-4adb-acc4-bc8e2cff73ff None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.351357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec501e0-860d-4adb-acc4-bc8e2cff73ff None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.351653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec501e0-860d-4adb-acc4-bc8e2cff73ff None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.353176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 515/1045] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:31.355048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:31.355726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.356005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.356273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.357107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:31.357943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.358227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.358497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.358587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:31.377003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:31.378386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:31.382369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 531/1046] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:59:31 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:31.456769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 516/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:31.479608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:31.600353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed637-f159-4c38-a311-dc8fee2fb778 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:31.602765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:31.639311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:31.640143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.640425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.640697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.653253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:31.661570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:31.662600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:31.663423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 532/1048] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jun 7 12:59:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:31.669688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:31.694773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:31.777035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6c42-a5da-4ff0-954f-877d1167b854 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:31.812879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:31.813759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.814044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.814318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.815099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:31.815407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:31.816796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:31.825754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 517/1049] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 12:59:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:31.831880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:31.938786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e91dc7-f868-482d-bf25-bb6f620af9e5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:31.973214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:31.974024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:31.974314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:31.974589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:31.985407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:31.987031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:32.004320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:32.005509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:32.006473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:32.006473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:32.006473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:32.006473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:32.009103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 533/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:32.011411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:32.099540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:32.117360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527844d-a001-406f-b4a4-1a7c7c55fd63 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:32.152172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:32.153219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.153652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.154080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.154982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:32.155439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:32.156961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:32.174443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 518/1051] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:32.175519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:32.195839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:32.284916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2b6a-fac2-4df2-97a4-0250965a3b04 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:32.321406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:32.322456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.322887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.323308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.331438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:32.333108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:32.347505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:32.348521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:32.349512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 534/1052] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:59:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:32.356062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:32.459102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c754-9957-41d2-b177-6137deb0ea09 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:32.493565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:32.494540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.495000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.495476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.496499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:32.497028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:32.498631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:32.521504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 519/1053] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:59:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:32.523399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:32.621969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:32.645911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb119-17f4-4688-a2af-0d88af8a35db None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:32.680456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:32.681292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.681577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.681850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.692787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:32.694291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:32.712534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:32.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:32.714598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:32.714598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:32.714598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:32.714598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:32.717112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 535/1054] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:32.719641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:32.723077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:32.824473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4bd1d-3fd8-4c41-a798-4cea54af91fc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:32.858958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:32.859967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.860432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.860978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.861974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:32.862475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:32.864026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5917-c987-4298-8cf4-2f057f78026a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:32.880468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 520/1055] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:32.881750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:32.882595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87259e-64ac-4bfa-afdf-7011e2094d64 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.882873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87259e-64ac-4bfa-afdf-7011e2094d64 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.883183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87259e-64ac-4bfa-afdf-7011e2094d64 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.884561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 521/1056] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:32.889293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:32.889578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:32.889847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:32.907012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:32.908260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:32.985163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:32.986084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d7c7-ad08-463a-a067-02c196acdf9d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:32.998639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 522/1057] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:33.016759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:33.021275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.027782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.028607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.028885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.029190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.037336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.038826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:33.054415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:33.055326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:33.056203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 536/1058] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:33.061345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.123706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d51b9-b6d7-4686-9b3b-eeafdc16be95 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.158572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.159377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.159651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.159923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] PATH_INFO: `/v3/services/image` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.160580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.161972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.162071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc1e02-d9af-44da-9ca0-45a1ef230004 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:33.174018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:33.175241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:33.176166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 523/1059] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jun 7 12:59:33 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:33.181112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.201439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.202106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.202384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.202653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.203452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:33.203758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.205314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.218684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 537/1060] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:33.224852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.252555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:33.286781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:33.302210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463548c5-ebf0-45fc-8a7d-ef5619349744 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.340435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.340819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179400b-b968-4adf-9c1d-fe0173ea0448 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.341164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.341450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.341728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.342455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] RBAC: Adding query filter params (name=image) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:33.342798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.344183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.354366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 524/1061] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:33.355582 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.386015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.386876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.387164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.387438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/4bfe0c829ddb45cbb59b275e4c8349f4/roles/542a6167f7124fabbd8380cc662360f6` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.389852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=4bfe0c829ddb45cbb59b275e4c8349f4, role_id=542a6167f7124fabbd8380cc662360f6)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.391314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.412339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 538/1062] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:59:33 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/4bfe0c829ddb45cbb59b275e4c8349f4/roles/542a6167f7124fabbd8380cc662360f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:59:33.473286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ccb4-8096-422d-a96b-1fb5ea778286 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.494639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:33.510432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.511115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.511388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.511655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.512394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] RBAC: Adding query filter params (type=image) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:33.512707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.514559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fda7f1-c525-4f9c-b005-193df45d2154 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.525281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 525/1063] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:33.527448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.653589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee499c-cdad-4c60-bda4-e16f4f41bb6b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.664391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:33.692711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.693427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.693738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.694018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.694778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:33.696160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:33.701296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452117a2-5f78-4d10-aa9e-382bdf5319c6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.701583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452117a2-5f78-4d10-aa9e-382bdf5319c6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.701892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452117a2-5f78-4d10-aa9e-382bdf5319c6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.703414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 526/1064] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 12:59:33.708807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7945-1998-47a3-a326-816ab743514b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.709226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7945-1998-47a3-a326-816ab743514b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.709511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7945-1998-47a3-a326-816ab743514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:33.717811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 539/1065] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 12:59:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:33.727874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-35fb7945-1998-47a3-a326-816ab743514b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:33.729151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-35fb7945-1998-47a3-a326-816ab743514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:33.817555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 527/1066] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:33.841390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:33.951455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7439c-3c11-4b90-9377-b28ab599e022 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:33.988271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:33.989107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:33.989389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:33.989658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:34.001979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:34.009555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:34.010464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:34.011763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 540/1067] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:34.018932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7945-1998-47a3-a326-816ab743514b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:34.119689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7945-1998-47a3-a326-816ab743514b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:34.132130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:34.158161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:34.158836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:34.159119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:34.159392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:34.160140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:34.160445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:34.161829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:34.175429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 528/1068] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:34.176880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:34.205911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:34.287433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc4e8-3715-4ba2-9b81-fc6f9fc82278 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:34.321473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:34.322358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:34.322632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:34.322907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] PATH_INFO: `/v3/users/3be842d78bc3449099636f3e58ac8e84` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:34.336769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=3be842d78bc3449099636f3e58ac8e84)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:34.338254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:34.340190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 541/1069] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:34 2022] GET /identity/v3/users/3be842d78bc3449099636f3e58ac8e84 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:34.346026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:34.454967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20b577-3367-4a31-955f-bb3020e24277 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:34.490345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:34.490982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:34.491263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:34.491535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:34.535196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:34.564681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:34.566207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:34.669428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 529/1070] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:34.675197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:34.759518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:34.781409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768b5d-120c-42b0-aa7c-823f707fc1b3 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:34.816462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6c06d-4f2f-4acc-ab2a-3e5d78e07d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:34.817355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c06d-4f2f-4acc-ab2a-3e5d78e07d9a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:34.817633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c06d-4f2f-4acc-ab2a-3e5d78e07d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:34.817900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c06d-4f2f-4acc-ab2a-3e5d78e07d9a None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:34.819113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6c06d-4f2f-4acc-ab2a-3e5d78e07d9a None admin] RBAC: Authorizing `identity:get_project(project_id=3850d5676f894c35b5d93a625a9022dc)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:34.820555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6c06d-4f2f-4acc-ab2a-3e5d78e07d9a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:34.822476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 542/1071] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:59:34 2022] GET /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:34.828436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:34.900733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:34.932675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69da24-f8a5-43fb-8f34-e19b13444326 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:34.968110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:34.968783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:34.969086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:34.969356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:34.970199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=3850d5676f894c35b5d93a625a9022dc, user.id=3be842d78bc3449099636f3e58ac8e84) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:34.970506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:34.971937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163ed7-cbb1-4d2d-84a4-7c3d0db4ce28 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:34.978058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 530/1072] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:34 2022] GET /identity/v3/role_assignments?user.id=3be842d78bc3449099636f3e58ac8e84&scope.project.id=3850d5676f894c35b5d93a625a9022dc&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:35.691055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574566b-a81e-41ec-9a4e-1d00abace276 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:35.691689 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574566b-a81e-41ec-9a4e-1d00abace276 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:35.691689 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574566b-a81e-41ec-9a4e-1d00abace276 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:35.693004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 543/1073] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:35.699596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:35.700185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:35.700185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:35.719018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:35.720273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:35.793060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 531/1074] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:35.816749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574566b-a81e-41ec-9a4e-1d00abace276 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:35.925523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574566b-a81e-41ec-9a4e-1d00abace276 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:35.959803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfccde8-63b8-4b36-896e-871d854cc4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:35.960626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfccde8-63b8-4b36-896e-871d854cc4ee None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:35.960909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfccde8-63b8-4b36-896e-871d854cc4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:35.961252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfccde8-63b8-4b36-896e-871d854cc4ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:35.973193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfccde8-63b8-4b36-896e-871d854cc4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-0dfccde8-63b8-4b36-896e-871d854cc4ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:35.981362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:35.982324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:35.983219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 544/1075] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jun 7 12:59:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:35.988872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.035964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e54f3-9943-4d6a-ad4b-8d86e79d9fb1 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.036252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e54f3-9943-4d6a-ad4b-8d86e79d9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.036527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e54f3-9943-4d6a-ad4b-8d86e79d9fb1 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.038079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 545/1076] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:36.042739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.042984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.043286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.058498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.060793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:36.062119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:36.066845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.100711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0ece-4c7a-4e4f-87d3-a8d2e8933d08 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.136078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.136765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.137070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.137351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.138150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:36.138459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.139903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.145764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 546/1077] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 12:59:36.149641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 532/1078] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 12:59:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:36.155236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.168740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.260558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea70c-afd7-4c85-811a-aeea9bd240c4 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.278566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34e57a-46fe-4d93-9bcf-1ca3c04e198c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.295941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.296664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.296941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.297239 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.305915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.306455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.309235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.310834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.315699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.316380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.316660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.316927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:36.329535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:36.330546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:36.331463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:36.331463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:36.331463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:36.331463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:36.331463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 547/1079] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:36.336501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.389002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.390644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.444330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b77e-eae2-4426-baf9-9ac9e6dc987d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.480725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.481428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.481712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.481988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.483126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:36.483439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.484979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.496937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 548/1080] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:36.497512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 533/1081] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:36.502673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.503363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.533724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.560819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.609428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41052b1-1979-4fa8-b10f-be059287fbbe None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.622193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d107fe-eaa7-45cf-9dbd-bb6e747c76f9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.643924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.644756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.645037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.645320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.655909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.657384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.661725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.662772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.663237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.663681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.672289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.674393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:36.675576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:36.676442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:36.677372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:36.677372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:36.677372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:36.677372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:36.677372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 534/1082] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:36.683035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 12:59:36.692198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:36.693566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 12:59:36.694896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:36.696444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 549/1083] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:36.699412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:36.775903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.796611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a3437-0a7f-4e34-97f2-07138fc30929 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.810565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510682bb-67eb-4787-b1e4-8c090aa2a148 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:36.824288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:36.835151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.835831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.836113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.836387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.837167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:36.837476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.838855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.846319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:36.847002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:36.847284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:36.847555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:36.848394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:36.848700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:36.850159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:36.861634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 535/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:36.885259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 550/1085] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:36.887232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.005768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d40fe-ed7b-4ba2-b3f9-95f57a59c547 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.045893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3d59-5668-4705-b9d9-2d87c6ee4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.046569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3d59-5668-4705-b9d9-2d87c6ee4214 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.046907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3d59-5668-4705-b9d9-2d87c6ee4214 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.047125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3d59-5668-4705-b9d9-2d87c6ee4214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.059264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.120850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3d59-5668-4705-b9d9-2d87c6ee4214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.122558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3d59-5668-4705-b9d9-2d87c6ee4214 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.228070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 536/1086] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:37.233101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.253405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d809a-94ef-484f-b5dd-500d467b77b9 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.253688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d809a-94ef-484f-b5dd-500d467b77b9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.253962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d809a-94ef-484f-b5dd-500d467b77b9 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.255340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 537/1087] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:37.260381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.260665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.260936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.278681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:37.279873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:37.314403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.334820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ac1a4-29ad-4936-89ab-0afc37cd6e98 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.347830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 538/1088] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:37.368317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.369151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.369434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.369704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.370472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.379968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.381459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 12:59:37.399172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:37.400280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:37.401300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 12:59:37.401300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 12:59:37.401300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 12:59:37.401300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:37.401533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 551/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:37.406094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.430756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.470178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea9d05-89b4-41c4-ad39-f3ae39a93ca1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.504161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99857c-8bdc-44e2-b455-0ed33aff81d8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.504922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.505844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.506119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.506386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.516573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:37.524955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:37.525913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 12:59:37.526745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 539/1090] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:37.532273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.541849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.542516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.542797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.543063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.543794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:37.544099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.545511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.556871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 552/1091] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:37.562417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.562620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.633038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325b1e-8519-4c57-a930-e28822cae876 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.644520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.663421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842e53-1d02-4e46-ad03-98e57a281327 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.668116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.668797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.669108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.669390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.670146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:37.670458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.671848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.680169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 540/1092] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:37.686008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.697306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.698116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.698397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.698658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.706575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.708054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 12:59:37.729854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:37.730878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:37.731795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 553/1093] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 12:59:37.740093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.787601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.796738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0cf06-e1ce-41b9-8e13-4742f71f9393 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.830691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.831565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.831838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.832109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] PATH_INFO: `/v3/users/3be842d78bc3449099636f3e58ac8e84` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.833318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3be842d78bc3449099636f3e58ac8e84)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.834748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.836369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 541/1094] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/users/3be842d78bc3449099636f3e58ac8e84 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:37.842214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.849756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e762d-df90-4586-9c84-b2666dfddc36 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.884415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.885164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.885575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.885847 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.886630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:37.886938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.888368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.900301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 554/1095] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 12:59:37.906388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:37.909264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:37.946626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d0eb-bd97-4dfe-aa82-7bd24fecd1e1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:37.982173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:37.983189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:37.983472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:37.983744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:37.984936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=3850d5676f894c35b5d93a625a9022dc)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:37.986610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:37.988335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 542/1096] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:37.994356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:38.005953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e97df-a8bd-4cd5-a381-75ae10007127 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:38.023183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:38.040007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:38.040667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:38.040946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:38.041225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:38.042062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] RBAC: Adding query filter params (role.id=542a6167f7124fabbd8380cc662360f6, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=4bfe0c829ddb45cbb59b275e4c8349f4) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:38.042374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:38.043814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160d9d-b3a9-47cb-a717-6e9176cc724a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:38.049733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 555/1097] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:37 2022] GET /identity/v3/role_assignments?user.id=4bfe0c829ddb45cbb59b275e4c8349f4&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=542a6167f7124fabbd8380cc662360f6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:38.098698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50489b4-4354-49a3-b910-8f21031ee4a5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:38.148435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542768-6cd1-461a-909e-da0393029298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:38.149285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542768-6cd1-461a-909e-da0393029298 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:38.149566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542768-6cd1-461a-909e-da0393029298 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:38.149829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542768-6cd1-461a-909e-da0393029298 None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc/users/3be842d78bc3449099636f3e58ac8e84/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:38.151971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542768-6cd1-461a-909e-da0393029298 None admin] RBAC: Authorizing `identity:create_grant(project_id=3850d5676f894c35b5d93a625a9022dc, user_id=3be842d78bc3449099636f3e58ac8e84, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:38.153463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542768-6cd1-461a-909e-da0393029298 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:38.169941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 543/1098] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:59:37 2022] PUT /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc/users/3be842d78bc3449099636f3e58ac8e84/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 12:59:40.402341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ec3d-ff4f-4520-83cc-75b1e854ff75 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:40.402933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ec3d-ff4f-4520-83cc-75b1e854ff75 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:40.402933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ec3d-ff4f-4520-83cc-75b1e854ff75 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:40.404873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 556/1099] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:40.411521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ab43-8937-4614-b056-694690a0a90e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:40.411958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ab43-8937-4614-b056-694690a0a90e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:40.412045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ab43-8937-4614-b056-694690a0a90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:40.429519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1958ab43-8937-4614-b056-694690a0a90e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:40.430677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1958ab43-8937-4614-b056-694690a0a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:40.498901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 544/1100] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:40.523178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8ec3d-ff4f-4520-83cc-75b1e854ff75 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:40.601740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:40.639640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8ec3d-ff4f-4520-83cc-75b1e854ff75 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:40.672713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:40.673602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:40.673891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:40.674164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:40.684104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 12:59:40.691748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 12:59:40.692790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 12:59:40.693897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 557/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 12:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 12:59:40.702467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958ab43-8937-4614-b056-694690a0a90e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:40.723025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:40.808183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958ab43-8937-4614-b056-694690a0a90e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:40.853512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:40.854172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:40.854451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:40.854715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:40.855465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:40.855769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:40.857217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:40.865660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 545/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 12:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:40.871750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:40.976021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccc2c4-d31a-41bf-be1f-92ae6a562d1b None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:41.002607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:41.016478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:41.017653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:41.017929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:41.018200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] PATH_INFO: `/v3/users/3be842d78bc3449099636f3e58ac8e84` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:41.019487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] RBAC: Authorizing `identity:get_user(user_id=3be842d78bc3449099636f3e58ac8e84)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:41.020975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:41.022640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 558/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:40 2022] GET /identity/v3/users/3be842d78bc3449099636f3e58ac8e84 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:41.028875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:41.127507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:41.151378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e34e7c-6ae6-47c5-a852-2e2ce70c2053 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:41.187370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:41.188014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:41.188295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:41.188569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:41.257574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:41.258957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:41.347341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:41.368421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 546/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:41.377759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:41.485669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faaa91-f5e4-4cb6-82fb-b177e2a19618 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:41.525731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333c1e-6d49-465c-be92-861c600215d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:41.526567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333c1e-6d49-465c-be92-861c600215d4 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:41.526844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333c1e-6d49-465c-be92-861c600215d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:41.527107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333c1e-6d49-465c-be92-861c600215d4 None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:41.528418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa333c1e-6d49-465c-be92-861c600215d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3850d5676f894c35b5d93a625a9022dc)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:41.529989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa333c1e-6d49-465c-be92-861c600215d4 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:41.531663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 559/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:59:41 2022] GET /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:41.538063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:41.643353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d36d-6eca-4e69-95d6-ee2927ed0c58 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:41.684153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:41.684807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:41.685176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:41.685528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:41.686371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=3850d5676f894c35b5d93a625a9022dc, user.id=3be842d78bc3449099636f3e58ac8e84) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:41.686681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:41.688106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92a6cb-e5a1-4007-9e11-16c7900d78a1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:41.694098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 547/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:41 2022] GET /identity/v3/role_assignments?user.id=3be842d78bc3449099636f3e58ac8e84&scope.project.id=3850d5676f894c35b5d93a625a9022dc&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:44.034118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247433b-e265-4c1b-bd24-c7bf39b93a0e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:44.034641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247433b-e265-4c1b-bd24-c7bf39b93a0e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:44.034641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247433b-e265-4c1b-bd24-c7bf39b93a0e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:44.036704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 560/1107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:44.045776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:44.046167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:44.046417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:44.066447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:44.067643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:44.110863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:44.142353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 548/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:44.174109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247433b-e265-4c1b-bd24-c7bf39b93a0e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:44.239394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:44.285874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247433b-e265-4c1b-bd24-c7bf39b93a0e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:44.323092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aef5a-8c16-41e1-a567-2c87a430d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:44.323875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aef5a-8c16-41e1-a567-2c87a430d3ff None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:44.324152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aef5a-8c16-41e1-a567-2c87a430d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:44.324425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aef5a-8c16-41e1-a567-2c87a430d3ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:44.325716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aef5a-8c16-41e1-a567-2c87a430d3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:44.327249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aef5a-8c16-41e1-a567-2c87a430d3ff None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:44.328870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 561/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:44.335781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:44.444002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c6a78-c008-40d9-a815-f478dc581b0f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:44.479300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002083ba-9a8e-40e1-8e89-4227828da0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:44.479963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002083ba-9a8e-40e1-8e89-4227828da0cb None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:44.480212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002083ba-9a8e-40e1-8e89-4227828da0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:44.480508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002083ba-9a8e-40e1-8e89-4227828da0cb None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:44.481254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002083ba-9a8e-40e1-8e89-4227828da0cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:44.482688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002083ba-9a8e-40e1-8e89-4227828da0cb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:44.505798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 549/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:59:44 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:46.751876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95978f-a4c8-483f-88eb-b1b6088e3daa None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:46.752719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95978f-a4c8-483f-88eb-b1b6088e3daa None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:46.752889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95978f-a4c8-483f-88eb-b1b6088e3daa None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:46.755200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 562/1111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:46.760705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:46.761157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:46.761262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:46.781129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:46.782294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:46.810868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:46.863264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 550/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:46.886537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95978f-a4c8-483f-88eb-b1b6088e3daa None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:46.995960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95978f-a4c8-483f-88eb-b1b6088e3daa None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:47.025059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:47.032255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:47.033131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:47.033441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:47.033717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] PATH_INFO: `/v3/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:47.035304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] RBAC: Authorizing `identity:get_role(role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:47.036687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:47.038098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 563/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:46 2022] GET /identity/v3/roles/d0a91103ec054c63b098cc4abec5731f => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:47.044252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:47.154824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8964f-181c-4b3d-b89d-95deb7c66e3a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:47.189617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:47.190491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:47.190772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:47.191039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] PATH_INFO: `/v3/users/48d2dbba6cb34cabb369449892f22661` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:47.204707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] RBAC: Authorizing `identity:get_user(user_id=48d2dbba6cb34cabb369449892f22661)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:47.206305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:47.207956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 551/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:47 2022] GET /identity/v3/users/48d2dbba6cb34cabb369449892f22661 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:47.214509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:47.333396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61afb8-ebbd-44d8-9840-db7bb2b89a98 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:47.370155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:47.370907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:47.371178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:47.371495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:47.445349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:47.449914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:47.451440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:47.570983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 564/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:47.578103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:47.605321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:47.698879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6455d2-6d81-42af-8c85-22db38d26362 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:47.740304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e286980-0b74-413d-a580-9f100144db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:47.741218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e286980-0b74-413d-a580-9f100144db79 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:47.741505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e286980-0b74-413d-a580-9f100144db79 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:47.742133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e286980-0b74-413d-a580-9f100144db79 None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:47.743898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e286980-0b74-413d-a580-9f100144db79 None admin] RBAC: Authorizing `identity:get_project(project_id=3850d5676f894c35b5d93a625a9022dc)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:47.746034 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e286980-0b74-413d-a580-9f100144db79 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:47.748677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 552/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:59:47 2022] GET /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:47.757733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:47.874364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:47.878263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9abca-1a54-4452-937c-e5f04b550d51 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:47.916720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:47.917543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:47.917827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:47.918098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:47.918930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] RBAC: Adding query filter params (role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=3850d5676f894c35b5d93a625a9022dc, user.id=48d2dbba6cb34cabb369449892f22661) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:47.919240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:47.920714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dc07-3562-4a5d-98ea-f333a8a57154 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:47.926697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 565/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:47 2022] GET /identity/v3/role_assignments?user.id=48d2dbba6cb34cabb369449892f22661&scope.project.id=3850d5676f894c35b5d93a625a9022dc&role.id=d0a91103ec054c63b098cc4abec5731f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:50.150904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff6139-7d77-4b1d-8263-e51d3fcce7ba None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:50.151786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff6139-7d77-4b1d-8263-e51d3fcce7ba None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:50.151786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff6139-7d77-4b1d-8263-e51d3fcce7ba None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:50.154051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 553/1118] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:50.159836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:50.160255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:50.160363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:50.178991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:50.180181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:50.260256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 566/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:50.291836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff6139-7d77-4b1d-8263-e51d3fcce7ba None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:50.396222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:50.413643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff6139-7d77-4b1d-8263-e51d3fcce7ba None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:50.449306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:50.450144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:50.450453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:50.450728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] PATH_INFO: `/v3/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:50.452307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] RBAC: Authorizing `identity:get_role(role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:50.453699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:50.455512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 554/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:50 2022] GET /identity/v3/roles/d0a91103ec054c63b098cc4abec5731f => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:50.461907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:50.563667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:50.573664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4990-3c6f-418f-b522-754607db39b4 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:50.611755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:50.612646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:50.612921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:50.613224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] PATH_INFO: `/v3/users/48d2dbba6cb34cabb369449892f22661` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:50.614467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] RBAC: Authorizing `identity:get_user(user_id=48d2dbba6cb34cabb369449892f22661)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:50.615910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:50.617591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 567/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:50 2022] GET /identity/v3/users/48d2dbba6cb34cabb369449892f22661 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:50.623592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:50.742814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3112-84c3-4152-81d3-5ec43b82f347 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:50.781005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b1fd2-720f-4fbd-84b6-8b1db5b788dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:50.781879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b1fd2-720f-4fbd-84b6-8b1db5b788dd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:50.782157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b1fd2-720f-4fbd-84b6-8b1db5b788dd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:50.782400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b1fd2-720f-4fbd-84b6-8b1db5b788dd None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:50.783738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b1fd2-720f-4fbd-84b6-8b1db5b788dd None admin] RBAC: Authorizing `identity:get_project(project_id=3850d5676f894c35b5d93a625a9022dc)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:50.785209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b1fd2-720f-4fbd-84b6-8b1db5b788dd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:50.786879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 555/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:59:50 2022] GET /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:50.793136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:50.902964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61078cdb-0f04-4b92-bea5-1d0490ac092d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:50.938747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdafb3-1463-48ef-88ce-93f8c0474ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:50.939787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdafb3-1463-48ef-88ce-93f8c0474ddf None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:50.940069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdafb3-1463-48ef-88ce-93f8c0474ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:50.940342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdafb3-1463-48ef-88ce-93f8c0474ddf None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc/users/48d2dbba6cb34cabb369449892f22661/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:50.942977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdafb3-1463-48ef-88ce-93f8c0474ddf None admin] RBAC: Authorizing `identity:create_grant(project_id=3850d5676f894c35b5d93a625a9022dc, user_id=48d2dbba6cb34cabb369449892f22661, role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:50.944419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdafb3-1463-48ef-88ce-93f8c0474ddf None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:50.966203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 568/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 12:59:50 2022] PUT /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc/users/48d2dbba6cb34cabb369449892f22661/roles/d0a91103ec054c63b098cc4abec5731f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 12:59:53.194024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad50-1bf9-4cd0-ae17-48439e38d3fe None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:53.194916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad50-1bf9-4cd0-ae17-48439e38d3fe None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:53.194916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad50-1bf9-4cd0-ae17-48439e38d3fe None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:53.197059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 556/1124] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:53.202621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:53.203070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:53.203171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:53.221948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:53.223133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:53.239120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:53.301071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 569/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:53.325458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad50-1bf9-4cd0-ae17-48439e38d3fe None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:53.353547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:53.440016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad50-1bf9-4cd0-ae17-48439e38d3fe None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:53.476111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:53.476897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:53.477202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:53.477467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] PATH_INFO: `/v3/roles/d0a91103ec054c63b098cc4abec5731f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:53.479055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] RBAC: Authorizing `identity:get_role(role_id=d0a91103ec054c63b098cc4abec5731f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:53.480411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:53.481837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 557/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:53 2022] GET /identity/v3/roles/d0a91103ec054c63b098cc4abec5731f => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:53.490328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:53.604906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33377fd-30ff-475e-9131-a3bdbd57b382 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:53.645056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:53.645952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:53.646233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:53.646506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] PATH_INFO: `/v3/users/48d2dbba6cb34cabb369449892f22661` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:53.648110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] RBAC: Authorizing `identity:get_user(user_id=48d2dbba6cb34cabb369449892f22661)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:53.649600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:53.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 570/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 12:59:53 2022] GET /identity/v3/users/48d2dbba6cb34cabb369449892f22661 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:53.658117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:53.771449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:53.783935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956bab4-9d1a-4133-8bb6-1ab19487af40 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:53.825477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:53.826129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:53.826417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:53.826692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:53.898623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:53.900063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:54.000576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:54.012505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 558/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 12:59:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 12:59:54.022436 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:54.046936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:54.140756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7804-785c-4013-ae0f-6b9d180350d0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:54.177712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb4ee-b834-4803-a327-80eeb6cb2698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:54.178579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb4ee-b834-4803-a327-80eeb6cb2698 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:54.178860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb4ee-b834-4803-a327-80eeb6cb2698 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:54.179133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb4ee-b834-4803-a327-80eeb6cb2698 None admin] PATH_INFO: `/v3/projects/3850d5676f894c35b5d93a625a9022dc` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:54.180358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cb4ee-b834-4803-a327-80eeb6cb2698 None admin] RBAC: Authorizing `identity:get_project(project_id=3850d5676f894c35b5d93a625a9022dc)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:54.181837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cb4ee-b834-4803-a327-80eeb6cb2698 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:54.183552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 571/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 12:59:54 2022] GET /identity/v3/projects/3850d5676f894c35b5d93a625a9022dc => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:54.190147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:54.293992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc242-76d4-4794-a0b0-282219fd87a0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:54.331528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:54.332183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:54.332456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:54.332725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:54.333591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] RBAC: Adding query filter params (role.id=d0a91103ec054c63b098cc4abec5731f, scope.project.id=3850d5676f894c35b5d93a625a9022dc, user.id=48d2dbba6cb34cabb369449892f22661) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 12:59:54.333899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:54.335325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd061d0-538f-42c4-abfd-df03e300826a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:54.341995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 559/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 12:59:54 2022] GET /identity/v3/role_assignments?user.id=48d2dbba6cb34cabb369449892f22661&scope.project.id=3850d5676f894c35b5d93a625a9022dc&role.id=d0a91103ec054c63b098cc4abec5731f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:56.583984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbfdd-ede9-4d46-bd51-2545cec3439d None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:56.584563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbfdd-ede9-4d46-bd51-2545cec3439d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:56.584563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbfdd-ede9-4d46-bd51-2545cec3439d None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:56.585923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 572/1131] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:56.592341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:56.593104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:56.593268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:56.614121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:56.615316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:56.676316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:56.694266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 560/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:56.717934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbfdd-ede9-4d46-bd51-2545cec3439d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:56.817619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:56.838182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbfdd-ede9-4d46-bd51-2545cec3439d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:56.879427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1349cf-7e05-4a5d-b471-7f02d98c149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:56.880228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1349cf-7e05-4a5d-b471-7f02d98c149d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:56.880512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1349cf-7e05-4a5d-b471-7f02d98c149d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:56.880788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1349cf-7e05-4a5d-b471-7f02d98c149d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:56.882036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1349cf-7e05-4a5d-b471-7f02d98c149d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:56.883510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1349cf-7e05-4a5d-b471-7f02d98c149d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:56.885289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 573/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:56.891169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:56.992799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d943c-0671-4aab-b3ae-bc3fc073588c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:57.029274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd797b-c0f6-4a4d-93b2-829199c0e183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:57.029923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd797b-c0f6-4a4d-93b2-829199c0e183 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:57.030202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd797b-c0f6-4a4d-93b2-829199c0e183 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:57.030470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd797b-c0f6-4a4d-93b2-829199c0e183 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:57.031184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd797b-c0f6-4a4d-93b2-829199c0e183 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:57.032693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd797b-c0f6-4a4d-93b2-829199c0e183 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:57.061471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 561/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 12:59:56 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 12:59:59.322602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e3e8-57f9-4ab3-a18c-1dd9afc239a2 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:59.323492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e3e8-57f9-4ab3-a18c-1dd9afc239a2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:59.323492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e3e8-57f9-4ab3-a18c-1dd9afc239a2 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:59.325763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 574/1135] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 12:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 12:59:59.332495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:59.333238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:59.333354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:59.356584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 12:59:59.357798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 12:59:59.395311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 12:59:59.441944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 562/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 12:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 12:59:59.472230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e3e8-57f9-4ab3-a18c-1dd9afc239a2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:59.585932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e3e8-57f9-4ab3-a18c-1dd9afc239a2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:59.619954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce8d1f-2852-4773-8c8f-a813980ffb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:59.620747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8d1f-2852-4773-8c8f-a813980ffb40 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:59.621053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8d1f-2852-4773-8c8f-a813980ffb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:59.621314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8d1f-2852-4773-8c8f-a813980ffb40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:59.622536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce8d1f-2852-4773-8c8f-a813980ffb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:59.623962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce8d1f-2852-4773-8c8f-a813980ffb40 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:59.625609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 575/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 12:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 12:59:59.631611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 12:59:59.736105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f464c12-4903-4b4e-9722-6b56b1a07e3a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 12:59:59.771082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e6c37-fea9-463c-b5ec-c3d231818586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 12:59:59.771762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6c37-fea9-463c-b5ec-c3d231818586 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 12:59:59.772039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6c37-fea9-463c-b5ec-c3d231818586 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 12:59:59.772304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6c37-fea9-463c-b5ec-c3d231818586 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 12:59:59.773397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e6c37-fea9-463c-b5ec-c3d231818586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 12:59:59.774834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e6c37-fea9-463c-b5ec-c3d231818586 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 12:59:59.797320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 563/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 12:59:59 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:00:02.057463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bf226-726d-4a9b-abaf-727a61ef6956 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:02.057990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bf226-726d-4a9b-abaf-727a61ef6956 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:02.057990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bf226-726d-4a9b-abaf-727a61ef6956 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:02.059287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 576/1139] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:02.066116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:02.066795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:02.066993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:02.087285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:02.088478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:02.107663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:02.162662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 564/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:02.186507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bf226-726d-4a9b-abaf-727a61ef6956 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:02.217956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:02.302346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bf226-726d-4a9b-abaf-727a61ef6956 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:02.337237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:02.337964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:02.338241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:02.338514 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:02.349599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:00:02.357145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:02.358194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:00:02.359198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 577/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:02.365542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:02.482540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ecdf6-ff61-40c8-bb86-46582b41cfe6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:02.518500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:02.519161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:02.519436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:02.519702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:02.520450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:02.520757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:02.522151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:02.530789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 565/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:02.537309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:02.627305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:02.646648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9392-773d-4e34-91c5-c717020bf237 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:02.682197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:02.683076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:02.683358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:02.683631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] PATH_INFO: `/v3/users/264408307ae642d4b96709528d28b206` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:02.697750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] RBAC: Authorizing `identity:get_user(user_id=264408307ae642d4b96709528d28b206)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:02.699207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:02.700856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 578/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 13:00:02 2022] GET /identity/v3/users/264408307ae642d4b96709528d28b206 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:02.708041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:02.734367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:02.832736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdcc7-28e2-47ba-a97e-66ed88b25196 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:02.869778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:02.870355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:02.870638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:02.870912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:02.942862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:02.944332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:02.960603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:03.050247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 566/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:00:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:00:03.059861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:03.166421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce21fd0-a33b-44cd-a130-3d31bb751d0c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:03.204242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5ea8-0e86-4c97-97d7-05affe0ae581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:03.205411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5ea8-0e86-4c97-97d7-05affe0ae581 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:03.205690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5ea8-0e86-4c97-97d7-05affe0ae581 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:03.205962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5ea8-0e86-4c97-97d7-05affe0ae581 None admin] PATH_INFO: `/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:03.207264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5ea8-0e86-4c97-97d7-05affe0ae581 None admin] RBAC: Authorizing `identity:get_project(project_id=7e3bda773335404d8cfa4ba03cdb41a4)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:03.208704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5ea8-0e86-4c97-97d7-05affe0ae581 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:03.210472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 579/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 13:00:03 2022] GET /identity/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:03.217143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:03.326671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654778-5857-4dc4-ba0d-473c226ef190 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:03.340926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:03.371541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:03.372201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:03.372486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:03.372761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:03.373637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=7e3bda773335404d8cfa4ba03cdb41a4, user.id=264408307ae642d4b96709528d28b206) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:03.373953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:03.375386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84539-b96f-4f9f-85d7-b5ba64fa7c81 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:03.381320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 567/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:00:03 2022] GET /identity/v3/role_assignments?user.id=264408307ae642d4b96709528d28b206&scope.project.id=7e3bda773335404d8cfa4ba03cdb41a4&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:05.575063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f98bbc-2a9a-4517-9ac7-792fe42e8404 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:05.575621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f98bbc-2a9a-4517-9ac7-792fe42e8404 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:05.575621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f98bbc-2a9a-4517-9ac7-792fe42e8404 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:05.577342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 580/1147] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:05.583015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:05.583485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:05.583584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:05.601276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:05.602446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:05.675782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 568/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:05.710173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f98bbc-2a9a-4517-9ac7-792fe42e8404 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:05.723256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:05.818920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f98bbc-2a9a-4517-9ac7-792fe42e8404 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:05.853739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:05.854454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:05.854732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:05.854997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:05.865289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:00:05.872794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:05.874072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:00:05.875227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 581/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:05.880188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:05.990099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e746b-e2ce-4314-834b-018b9ce47c27 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:05.999588 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:06.029523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06757247-d402-46fe-8cee-091388304829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:06.030190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06757247-d402-46fe-8cee-091388304829 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:06.030470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06757247-d402-46fe-8cee-091388304829 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:06.030741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06757247-d402-46fe-8cee-091388304829 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:06.031492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06757247-d402-46fe-8cee-091388304829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:06.031798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06757247-d402-46fe-8cee-091388304829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:06.033252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06757247-d402-46fe-8cee-091388304829 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:06.041377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 569/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:06.048254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:06.135685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:06.171402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ea389-e3d4-4add-83a8-798fb116195a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:06.206062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:06.206942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:06.207219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:06.207486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] PATH_INFO: `/v3/users/264408307ae642d4b96709528d28b206` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:06.208782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] RBAC: Authorizing `identity:get_user(user_id=264408307ae642d4b96709528d28b206)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:06.210246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:06.211871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 582/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 13:00:06 2022] GET /identity/v3/users/264408307ae642d4b96709528d28b206 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:06.217926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06757247-d402-46fe-8cee-091388304829 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:06.323362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06757247-d402-46fe-8cee-091388304829 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:06.358024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdd488-39ae-489e-b5dd-aebd4b978978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:06.358888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdd488-39ae-489e-b5dd-aebd4b978978 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:06.359163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdd488-39ae-489e-b5dd-aebd4b978978 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:06.359432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdd488-39ae-489e-b5dd-aebd4b978978 None admin] PATH_INFO: `/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:06.360863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdd488-39ae-489e-b5dd-aebd4b978978 None admin] RBAC: Authorizing `identity:get_project(project_id=7e3bda773335404d8cfa4ba03cdb41a4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:06.362340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdd488-39ae-489e-b5dd-aebd4b978978 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:06.364030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 570/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 13:00:06 2022] GET /identity/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:06.370822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:06.502603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f01d-434b-4333-ae8a-6085c171babc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:06.537308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7e729-d22c-4a96-bc3f-5e46d2f976e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:06.538194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7e729-d22c-4a96-bc3f-5e46d2f976e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:06.538470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7e729-d22c-4a96-bc3f-5e46d2f976e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:06.538737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7e729-d22c-4a96-bc3f-5e46d2f976e3 None admin] PATH_INFO: `/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4/users/264408307ae642d4b96709528d28b206/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:06.540925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7e729-d22c-4a96-bc3f-5e46d2f976e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e3bda773335404d8cfa4ba03cdb41a4, user_id=264408307ae642d4b96709528d28b206, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:06.542399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7e729-d22c-4a96-bc3f-5e46d2f976e3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:06.545569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:06.562502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 583/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 13:00:06 2022] PUT /identity/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4/users/264408307ae642d4b96709528d28b206/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:00:08.763117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ad89-6fc0-41a7-b149-4e22edc13237 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:08.763827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ad89-6fc0-41a7-b149-4e22edc13237 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:08.763827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ad89-6fc0-41a7-b149-4e22edc13237 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:08.765140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 571/1154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:08.771781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:08.772496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:08.773064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:08.800585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:08.801845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:08.872728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 584/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:08.911274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8ad89-6fc0-41a7-b149-4e22edc13237 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:08.958708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:09.035389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8ad89-6fc0-41a7-b149-4e22edc13237 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:09.073085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:09.073907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:09.074186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:09.074453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:09.086319 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:00:09.094260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:09.095496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:00:09.096478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 572/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:09.104111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:09.209782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674852-b762-4127-b0bb-f70638ab2e5d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:09.245365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:09.255728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:09.256397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:09.256675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:09.256946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:09.257729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:09.258037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:09.259410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:09.268693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 585/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:09.275371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:09.384225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:09.388342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba42b0-5e49-4d3d-a132-53e17c1ecf17 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:09.426867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:09.427738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:09.428010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:09.428279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] PATH_INFO: `/v3/users/264408307ae642d4b96709528d28b206` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:09.429935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] RBAC: Authorizing `identity:get_user(user_id=264408307ae642d4b96709528d28b206)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:09.431575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:09.433248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 573/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 13:00:09 2022] GET /identity/v3/users/264408307ae642d4b96709528d28b206 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:09.443377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:09.557255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604cfa-403a-4587-9fbc-0dd3b8a0995d None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:09.596321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:09.596976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:09.597289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:09.597561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:09.654398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:09.670159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:09.671631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:09.807685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 586/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:00:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:00:09.814452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:09.917602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35359a-be52-49dd-938b-429e8bd3d178 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:09.953032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849d72-fa92-438a-b8af-882687a32eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:09.953895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849d72-fa92-438a-b8af-882687a32eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:09.954174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849d72-fa92-438a-b8af-882687a32eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:09.954503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849d72-fa92-438a-b8af-882687a32eb7 None admin] PATH_INFO: `/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:09.955726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53849d72-fa92-438a-b8af-882687a32eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=7e3bda773335404d8cfa4ba03cdb41a4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:09.957197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53849d72-fa92-438a-b8af-882687a32eb7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:09.958886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 574/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 13:00:09 2022] GET /identity/v3/projects/7e3bda773335404d8cfa4ba03cdb41a4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:09.965506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:10.065653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:10.084286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2568f-e845-4b82-a012-05d8cd006a99 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:10.120281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:10.120944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:10.121254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:10.121528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:10.122359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=7e3bda773335404d8cfa4ba03cdb41a4, user.id=264408307ae642d4b96709528d28b206) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:10.122677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:10.124131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd195-15c5-4c8c-aff8-db867540d086 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:10.130411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 587/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:00:09 2022] GET /identity/v3/role_assignments?user.id=264408307ae642d4b96709528d28b206&scope.project.id=7e3bda773335404d8cfa4ba03cdb41a4&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:12.369657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc398-add5-458c-ad97-43c31be292b7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:12.370261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc398-add5-458c-ad97-43c31be292b7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:12.370261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc398-add5-458c-ad97-43c31be292b7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:12.371593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 575/1162] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:12.377998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:12.378707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:12.378855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:12.402077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:12.403278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:12.474504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 588/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:12.497126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc398-add5-458c-ad97-43c31be292b7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:12.538175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:12.609248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc398-add5-458c-ad97-43c31be292b7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:12.644207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:12.644793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:12.645101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:12.645375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:12.714524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:12.715965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:12.752389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:12.822052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 576/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:00:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:00:12.829262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:12.933953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:12.953455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4333d-babc-41df-a1ad-1544c5f73c75 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:12.998298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:12.999108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:12.999382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:12.999652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:13.006929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:13.008374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-90bc4de2-8a9a-4182-acb3-05b95bb52d37 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:13.023271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:13.024384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:00:13.025416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 589/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 13:00:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:13.031377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:13.138592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c9af-e3f2-4d05-9dc7-04e4096d60ae None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:13.174408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:13.175055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:13.175427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:13.175607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:13.176336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:13.176640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:13.180601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23098cfe-452f-4422-959f-c79aae82eb5c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:13.180601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:13.189001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 577/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jun 7 13:00:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:15.419807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5f23-3521-427b-bc2c-d2559d41a9dc None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:15.420375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5f23-3521-427b-bc2c-d2559d41a9dc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:15.420375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5f23-3521-427b-bc2c-d2559d41a9dc None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:15.422544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 590/1167] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:15.429191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5ec8-f772-4a2a-9d5d-f0550502463c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:15.429609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5ec8-f772-4a2a-9d5d-f0550502463c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:15.429766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5ec8-f772-4a2a-9d5d-f0550502463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:15.456305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7d6a5ec8-f772-4a2a-9d5d-f0550502463c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:15.457528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7d6a5ec8-f772-4a2a-9d5d-f0550502463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:15.527284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 578/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:15.558528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5f23-3521-427b-bc2c-d2559d41a9dc None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:15.680123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5f23-3521-427b-bc2c-d2559d41a9dc None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:15.722162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe765ba-25ff-4fa8-b5e2-2bb348b5b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:15.722819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe765ba-25ff-4fa8-b5e2-2bb348b5b4f0 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:15.723098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe765ba-25ff-4fa8-b5e2-2bb348b5b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:15.723371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe765ba-25ff-4fa8-b5e2-2bb348b5b4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:15.724118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe765ba-25ff-4fa8-b5e2-2bb348b5b4f0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:15.725527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe765ba-25ff-4fa8-b5e2-2bb348b5b4f0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:15.743002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 591/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Jun 7 13:00:15 2022] POST /identity/v3/domains => generated 267 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:00:18.018878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f370c-e185-4310-aed4-da8225594de2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:18.019712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f370c-e185-4310-aed4-da8225594de2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:18.019712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f370c-e185-4310-aed4-da8225594de2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:18.021845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 579/1170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:18.027668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:18.028105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:18.028206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:18.034165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:18.047781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:18.048980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:18.119795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 592/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:18.144722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f370c-e185-4310-aed4-da8225594de2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:18.263269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f370c-e185-4310-aed4-da8225594de2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:18.290219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:18.302613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7f87-c465-4849-8440-91afec0350c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:18.303479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7f87-c465-4849-8440-91afec0350c3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:18.303756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7f87-c465-4849-8440-91afec0350c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:18.304028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7f87-c465-4849-8440-91afec0350c3 None admin] PATH_INFO: `/v3/domains/95b7986a465d4fb9a06732ff5742fc3e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:18.315222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7f87-c465-4849-8440-91afec0350c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=95b7986a465d4fb9a06732ff5742fc3e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:18.316467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7f87-c465-4849-8440-91afec0350c3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:18.318142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 580/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jun 7 13:00:18 2022] GET /identity/v3/domains/95b7986a465d4fb9a06732ff5742fc3e => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:18.324208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:18.427377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d6cfc-a575-4e13-a865-840a9ca04b19 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:18.457044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:18.463200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d3f2-656f-48da-84d6-9313c51536d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:18.463856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d3f2-656f-48da-84d6-9313c51536d2 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:18.464133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d3f2-656f-48da-84d6-9313c51536d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:18.464397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d3f2-656f-48da-84d6-9313c51536d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:18.465148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082d3f2-656f-48da-84d6-9313c51536d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:18.466591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082d3f2-656f-48da-84d6-9313c51536d2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:18.495280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 593/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 13:00:18 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:00:20.757968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4843876-97c3-48cd-a9b2-67ad3c57a95f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:20.758553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4843876-97c3-48cd-a9b2-67ad3c57a95f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:20.758553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4843876-97c3-48cd-a9b2-67ad3c57a95f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:20.759888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 581/1174] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:20.766478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:20.767254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:20.767401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:20.787927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:20.789174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:20.863146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 594/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:20.893907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4843876-97c3-48cd-a9b2-67ad3c57a95f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:21.002884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4843876-97c3-48cd-a9b2-67ad3c57a95f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:21.042987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809fb22-9c18-4cc8-9839-ee43701263eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:21.043846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fb22-9c18-4cc8-9839-ee43701263eb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:21.044122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fb22-9c18-4cc8-9839-ee43701263eb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:21.044393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fb22-9c18-4cc8-9839-ee43701263eb None admin] PATH_INFO: `/v3/domains/95b7986a465d4fb9a06732ff5742fc3e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:21.045706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809fb22-9c18-4cc8-9839-ee43701263eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=95b7986a465d4fb9a06732ff5742fc3e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:21.047145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809fb22-9c18-4cc8-9839-ee43701263eb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:21.048761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 582/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jun 7 13:00:20 2022] GET /identity/v3/domains/95b7986a465d4fb9a06732ff5742fc3e => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:21.055442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:21.164361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72f10-8979-4ca1-8555-1c649ebddb0a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:21.178303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:21.210627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bb9f4-df35-4aa3-94e1-98b29d35fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:21.211302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb9f4-df35-4aa3-94e1-98b29d35fabd None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:21.211581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb9f4-df35-4aa3-94e1-98b29d35fabd None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:21.211853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb9f4-df35-4aa3-94e1-98b29d35fabd None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:21.212568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bb9f4-df35-4aa3-94e1-98b29d35fabd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:21.214057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bb9f4-df35-4aa3-94e1-98b29d35fabd None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:21.236050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 595/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 13:00:21 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:00:23.482016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08962c-80ea-4971-9256-54027b10ad51 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:23.482918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08962c-80ea-4971-9256-54027b10ad51 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:23.482918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08962c-80ea-4971-9256-54027b10ad51 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:23.485171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 583/1178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:23.490659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:23.491103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:23.491198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:23.509231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:23.510401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:23.580108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 596/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:23.603999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08962c-80ea-4971-9256-54027b10ad51 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:23.664885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:23.712870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08962c-80ea-4971-9256-54027b10ad51 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:23.748420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:23.749173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:23.749457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:23.749728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:23.761269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:00:23.769076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:23.770113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:00:23.770989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 584/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:23.779231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:23.878233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:23.881720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80bee-4c87-4b49-a885-5ef9dfe68b8b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:23.916110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:23.916772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:23.917061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:23.917352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:23.918096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:23.918402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:23.919798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:23.927883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 597/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:00:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:23.934030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:24.037648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5a78-9e13-43f7-9b5c-05bb9d2e3924 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:24.054473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:24.074102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:24.074974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:24.075258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:24.075540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] PATH_INFO: `/v3/users/c960a863f60e49d699ceca962f42093f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:24.089265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] RBAC: Authorizing `identity:get_user(user_id=c960a863f60e49d699ceca962f42093f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:24.090718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:24.092361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 585/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 13:00:23 2022] GET /identity/v3/users/c960a863f60e49d699ceca962f42093f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:24.098357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:24.200269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1fa2d-0eb1-43ef-b1e9-d8ede12077ab None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:24.235509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:24.236152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:24.236431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:24.236703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:24.267460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:24.306576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:24.307964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:24.412628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 598/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:00:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:00:24.419501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:24.530843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3f2e-b88f-4b2b-b936-6bff7a5872bf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:24.568303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81255071-ba69-498a-a73a-dd96f43a0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:24.569512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255071-ba69-498a-a73a-dd96f43a0557 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:24.569904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255071-ba69-498a-a73a-dd96f43a0557 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:24.570283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255071-ba69-498a-a73a-dd96f43a0557 None admin] PATH_INFO: `/v3/projects/41badf858320402aa72bcb7078913862` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:24.572329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81255071-ba69-498a-a73a-dd96f43a0557 None admin] RBAC: Authorizing `identity:get_project(project_id=41badf858320402aa72bcb7078913862)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:24.574209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81255071-ba69-498a-a73a-dd96f43a0557 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:24.576048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 586/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 13:00:24 2022] GET /identity/v3/projects/41badf858320402aa72bcb7078913862 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:24.585108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:24.652749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:24.699308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a884-31a4-4045-9cfd-8ab4af99eb95 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:24.747353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:24.748041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:24.748365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:24.748641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:24.749518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=41badf858320402aa72bcb7078913862, user.id=c960a863f60e49d699ceca962f42093f) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:24.749834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:24.751953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e38e2-1805-4e82-824f-a1261704ceff None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:24.759649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 599/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:00:24 2022] GET /identity/v3/role_assignments?user.id=c960a863f60e49d699ceca962f42093f&scope.project.id=41badf858320402aa72bcb7078913862&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:26.951552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3afe8-804f-4cea-9eea-f64a1f8085c1 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:26.952157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3afe8-804f-4cea-9eea-f64a1f8085c1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:26.952157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3afe8-804f-4cea-9eea-f64a1f8085c1 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:26.953404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 587/1186] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:26.959832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:26.960554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:26.960739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:26.983075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:26.984290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:27.057447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 600/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:27.080327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3afe8-804f-4cea-9eea-f64a1f8085c1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:27.127455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:27.189247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3afe8-804f-4cea-9eea-f64a1f8085c1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:27.227012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:27.227739 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:27.228017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:27.228292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:27.239303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:00:27.246880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:27.247947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:00:27.248926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 588/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:27.254761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:27.317807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:27.363351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d18cf-877f-481b-9572-5939467f4f2c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:27.398323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:27.398992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:27.399271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:27.399512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:27.400282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:27.400585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:27.401995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:27.411489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 601/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:27.418360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:27.524717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a158210-dbd9-4ec9-a658-259b4aa0c44a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:27.526264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:27.559016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:27.559890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:27.560154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:27.560427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] PATH_INFO: `/v3/users/c960a863f60e49d699ceca962f42093f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:27.561644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] RBAC: Authorizing `identity:get_user(user_id=c960a863f60e49d699ceca962f42093f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:27.563082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:27.564701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 589/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 13:00:27 2022] GET /identity/v3/users/c960a863f60e49d699ceca962f42093f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:27.570811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:27.673935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e44d6-7edd-4c9f-a510-42f7cd16e1fe None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:27.691146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:27.709290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5343c81-a0e9-44b3-b875-6f905424f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:27.710153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5343c81-a0e9-44b3-b875-6f905424f28f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:27.710428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5343c81-a0e9-44b3-b875-6f905424f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:27.710696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5343c81-a0e9-44b3-b875-6f905424f28f None admin] PATH_INFO: `/v3/projects/41badf858320402aa72bcb7078913862` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:27.711959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5343c81-a0e9-44b3-b875-6f905424f28f None admin] RBAC: Authorizing `identity:get_project(project_id=41badf858320402aa72bcb7078913862)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:27.713441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5343c81-a0e9-44b3-b875-6f905424f28f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:27.715163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 602/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 13:00:27 2022] GET /identity/v3/projects/41badf858320402aa72bcb7078913862 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:27.722020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:27.832385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ec9a-a10c-44bc-bb0d-784bf8cf90b0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:27.867364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20619860-2584-4a7d-b955-c6b0e93b88b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:27.868253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20619860-2584-4a7d-b955-c6b0e93b88b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:27.868533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20619860-2584-4a7d-b955-c6b0e93b88b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:27.868812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20619860-2584-4a7d-b955-c6b0e93b88b7 None admin] PATH_INFO: `/v3/projects/41badf858320402aa72bcb7078913862/users/c960a863f60e49d699ceca962f42093f/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:27.871048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20619860-2584-4a7d-b955-c6b0e93b88b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=41badf858320402aa72bcb7078913862, user_id=c960a863f60e49d699ceca962f42093f, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:27.872480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20619860-2584-4a7d-b955-c6b0e93b88b7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:27.893332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 590/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 13:00:27 2022] PUT /identity/v3/projects/41badf858320402aa72bcb7078913862/users/c960a863f60e49d699ceca962f42093f/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:00:30.082729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df8b9c-caf2-4327-bf77-6647a8489f65 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:30.083258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df8b9c-caf2-4327-bf77-6647a8489f65 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:30.083258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df8b9c-caf2-4327-bf77-6647a8489f65 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:30.084589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 603/1193] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:00:30.091106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:30.091790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:30.092062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:30.111788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:00:30.112987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:00:30.137453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:30.185341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 591/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:00:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:00:30.209355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df8b9c-caf2-4327-bf77-6647a8489f65 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:30.319620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df8b9c-caf2-4327-bf77-6647a8489f65 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:30.355474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:30.356185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:30.356468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:30.356743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:30.366848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:00:30.374407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:00:30.376064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:00:30.377385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 604/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:00:30.382022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:30.491184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b7655-b4f3-49f2-a769-4970589955a4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:30.531781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:30.532447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:30.532729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:30.533005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:30.533787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:30.534091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:30.535517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:30.543729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 592/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:30.549679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:30.598157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:30.656389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656d614-e532-4f48-9a95-4403dc48e80a None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:30.693701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:30.694586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:30.694863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:30.695131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] PATH_INFO: `/v3/users/c960a863f60e49d699ceca962f42093f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:30.696317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] RBAC: Authorizing `identity:get_user(user_id=c960a863f60e49d699ceca962f42093f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:30.697807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:30.699411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 605/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jun 7 13:00:30 2022] GET /identity/v3/users/c960a863f60e49d699ceca962f42093f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:30.705546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:30.732388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:30.811404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f31f0-fc92-4c54-bd0a-e39f49e6805a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:30.845879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:30.846518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:30.846864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:30.847142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:30.915685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:30.917059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:30.940396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:31.025778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 593/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:00:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:00:31.034765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:31.137663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90634064-96da-418c-82f8-6431dc7d3a81 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:31.151748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:31.173083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e017-a6be-4931-8947-37ab747f9351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:31.173878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e017-a6be-4931-8947-37ab747f9351 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:31.174160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e017-a6be-4931-8947-37ab747f9351 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:31.174429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e017-a6be-4931-8947-37ab747f9351 None admin] PATH_INFO: `/v3/projects/41badf858320402aa72bcb7078913862` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:31.175789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e017-a6be-4931-8947-37ab747f9351 None admin] RBAC: Authorizing `identity:get_project(project_id=41badf858320402aa72bcb7078913862)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:31.177248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e017-a6be-4931-8947-37ab747f9351 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:31.178931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 606/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jun 7 13:00:31 2022] GET /identity/v3/projects/41badf858320402aa72bcb7078913862 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:31.185261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:00:31.295859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948105-98ea-405c-9425-f8908160a454 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:00:31.321194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:31.333416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:00:31.334065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:00:31.334342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:00:31.334611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:00:31.335451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=41badf858320402aa72bcb7078913862, user.id=c960a863f60e49d699ceca962f42093f) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:00:31.335762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:00:31.337204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cecf0-5350-4ee3-861a-379cb3825c9f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:00:31.343178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 594/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:00:31 2022] GET /identity/v3/role_assignments?user.id=c960a863f60e49d699ceca962f42093f&scope.project.id=41badf858320402aa72bcb7078913862&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:00:41.168219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=9 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:00:41.340356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:33.090369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec000-cc87-4f4d-adc2-6e3ad210a993 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:33.090932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec000-cc87-4f4d-adc2-6e3ad210a993 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:33.090932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec000-cc87-4f4d-adc2-6e3ad210a993 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:33.092472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 607/1201] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:33.103454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:33.104092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:33.104092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:33.123049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:33.124236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:33.209929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 595/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:33.237416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec000-cc87-4f4d-adc2-6e3ad210a993 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:33.375383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec000-cc87-4f4d-adc2-6e3ad210a993 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:33.415400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:33.416211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:33.416579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:33.416764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:33.429794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:33.431499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:33.454233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:33.455343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:33.456703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:33.456703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:33.456703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:33.456703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:33.456703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 608/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:33.462498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:33.590567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c86576-ca03-40a5-ba97-47df050bea32 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:33.630196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:33.643715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:33.644432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:33.644737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:33.645028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:33.645936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:33.646243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:33.647984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721202f9-34c1-4171-90ce-eba611b5bff6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:33.661134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 596/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:33.668582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:33.732531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:33.797976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2172b-00a7-462e-bb7f-a7a9d894b097 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:33.840867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8623-9ba3-4d25-8df7-3190a4d1cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:33.841871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8623-9ba3-4d25-8df7-3190a4d1cd79 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:33.842309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8623-9ba3-4d25-8df7-3190a4d1cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:33.842738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8623-9ba3-4d25-8df7-3190a4d1cd79 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:33.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a8623-9ba3-4d25-8df7-3190a4d1cd79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:33.845280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a8623-9ba3-4d25-8df7-3190a4d1cd79 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:33.871375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 609/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jun 7 13:01:33 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:01:36.279811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468705f-fcdb-4b18-bf12-5fcef9d5e912 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:36.280377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468705f-fcdb-4b18-bf12-5fcef9d5e912 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:36.280377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468705f-fcdb-4b18-bf12-5fcef9d5e912 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:36.283903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 597/1206] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:36.287327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:36.287820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:36.287924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:36.306092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:36.307286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:36.389968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 610/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:36.425668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468705f-fcdb-4b18-bf12-5fcef9d5e912 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:36.555674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468705f-fcdb-4b18-bf12-5fcef9d5e912 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:36.600823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:36.602256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:36.603336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:36.603336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:36.620618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:01:36.628695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:36.629939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 13:01:36.630973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:36.631633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 598/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 13:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:36.637496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:36.685685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:36.767448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31858cff-3103-4fb7-aad8-650a3a47fa5d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:36.809614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:36.810387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:36.810748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:36.811061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:36.812115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:36.812582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:36.814355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:36.827140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 611/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 13:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:01:36.833283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:36.900002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:36.957669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e3b96-4f89-4a7f-94bf-1affc29f7e60 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:36.993721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:36.994748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:36.995165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:36.995529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:37.007362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:37.009375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:37.030858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:37.031990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:37.033078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:37.033078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:37.033078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:37.033078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:37.034008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 599/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:37.041589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:37.165636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:37.168908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50cf9-d97a-47d7-8000-4d7c3d5642cb None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:37.213117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:37.213883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:37.214180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:37.214493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:37.215305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:37.215614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:37.217035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:37.236503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 612/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:37.242575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:37.363592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3740046-64dc-4126-95a2-9adca0d62780 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:37.365462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:37.407407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:37.408679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:37.409214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:37.409492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:37.422964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:37.424754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 13:01:37.442770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:37.444201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:37.445907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 600/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:37.451991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:37.570370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a817f-f6a5-4406-8962-97b72ad810b8 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:37.617765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:37.618454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:37.619266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:37.619266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:37.620013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:37.620320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:37.621809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:37.650526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 613/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jun 7 13:01:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:37.651860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:37.772309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482fa9-23e1-4c45-a706-61cce8bed0d1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:37.815435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:37.816087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:37.816672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:37.816947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:37.851969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:37.894663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:37.896148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:38.014031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 601/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:01:38.020997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:38.045092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:38.137556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107fcf-590f-4326-bc9c-b5f6e14ded45 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:38.176860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:38.177819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:38.178139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:38.178541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:38.189603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:38.191093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:38.209148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:38.210166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:38.215804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:38.215804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:38.215804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:38.215804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:38.215804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 614/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:38.217286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:38.290095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:38.335127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef2795-2d12-4c41-8b7a-2a6f16ce618f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:38.371660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:38.373096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:38.373538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:38.373972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:38.374855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:38.375322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:38.376856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:38.391155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 602/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:38.397165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:38.492066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:38.529620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d656cdb-be3a-45a3-8fc4-442f4ebc0311 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:38.570999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:38.572417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:38.572908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:38.573388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:38.584638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:38.586221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 13:01:38.609497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:38.610742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:38.611842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:38.617647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 615/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 13:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 13:01:38.618918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:38.725546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf349e0-f530-46ba-8602-26ee8e91236d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:38.751729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:38.766975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:38.767781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:38.768153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:38.768514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:38.769566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:38.769873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:38.771522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2f7e5-0ab6-47ad-9b9d-bbaf15ef9873 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:38.786064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 603/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 13:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:38.792269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:38.907309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f914b-a1c4-4be1-8f41-7e12c1bbddeb None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:38.941128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:38.947830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:38.948563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:38.948907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:38.949271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:38.950187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=d775aea1464a40e2887ed69c25a34f58) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:38.950565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:38.952069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc226f64-d994-4172-a7a3-75153a441352 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:38.969050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 616/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:01:38 2022] GET /identity/v3/role_assignments?user.id=d775aea1464a40e2887ed69c25a34f58&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:41.324663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6aad-9f5d-4b41-a604-e7b8ba7959e6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:41.325254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6aad-9f5d-4b41-a604-e7b8ba7959e6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:41.325254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6aad-9f5d-4b41-a604-e7b8ba7959e6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:41.326805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 604/1220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:41.332742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:41.333221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:41.333405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:41.353316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:41.354536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:41.445101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 617/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:41.465833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6aad-9f5d-4b41-a604-e7b8ba7959e6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:41.592182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6aad-9f5d-4b41-a604-e7b8ba7959e6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:41.629247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:41.630069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:41.630353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:41.630632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:41.641423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:01:41.650157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:41.651254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:41.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 605/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 13:01:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:41.657988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:41.770271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683123bf-a9be-4d2e-a459-f3887544e48e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:41.796424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:41.809263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:41.810011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:41.810256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:41.810525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:41.811330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] RBAC: Adding query filter params (name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:41.811584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:41.812976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:41.821921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 618/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 13:01:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:41.828104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:41.874944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:41.935977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcbde7-450c-41ff-aca0-54f4c876a901 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:41.971531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:41.972425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:41.972744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:41.973100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:41.984764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:41.986525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:42.005465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:42.006528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:42.007456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:42.007456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:42.007456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:42.007456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:42.007456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 606/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:42.012974 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:42.118521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace6a4f-683e-4cce-9453-2cc026fc9669 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:42.161691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:42.162296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:42.162578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:42.162853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:42.163584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:42.163899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:42.165303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:42.179939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 619/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:42.186704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:42.296852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:42.304425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42debb-d54d-40a9-8e30-06f71b11d9c9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:42.340207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:42.341178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:42.341449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:42.341715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:42.351306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:42.353031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 13:01:42.369864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:42.371006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:42.372138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 607/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:42.377406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:42.443609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:42.501904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3f0d-1d67-4734-845c-151fe6deffbc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:42.538274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:42.538966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:42.539253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:42.539536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:42.540386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:42.540701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:42.542201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:42.561835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 620/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jun 7 13:01:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:01:42.568661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:42.694721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622636d-12b8-4662-bcaf-106648d5e870 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:42.731527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:42.732343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:42.732627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:42.732898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:42.745077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:42.746779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:42.765793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:42.766918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:42.767871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:42.767871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:42.767871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:42.767871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:42.767871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 608/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:42.773346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:42.883833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c19b0-b06e-42a8-b272-08f4c22de361 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:42.886168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:42.919179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:42.919848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:42.920184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:42.920458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:42.921278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:42.921603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:42.923069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:42.936184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 621/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:42.942072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:42.952661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:43.052531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b387-b931-4f01-86fd-6b36afb3c865 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:43.092952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:43.093786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:43.094066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:43.094334 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:43.102888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:43.104721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 13:01:43.122050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:43.123062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:43.124218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 609/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 13:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:43.130045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:43.249329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea10657-42e4-4319-99d7-08ecbbebcec0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:43.287305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:43.287936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:43.288225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:43.288487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:43.289319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:43.289637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:43.291080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705f8f-e958-419e-a576-7e11f4f27af3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:43.304254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 622/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 13:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:43.310690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:43.378970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:43.425437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88262d49-78dd-4c2f-b4d2-ba35ba80b377 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:43.464848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4771-b641-46e7-8e5c-47f1c9fef0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:43.465778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4771-b641-46e7-8e5c-47f1c9fef0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:43.466061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4771-b641-46e7-8e5c-47f1c9fef0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:43.466330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4771-b641-46e7-8e5c-47f1c9fef0a1 None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/d775aea1464a40e2887ed69c25a34f58/roles/fe934b3ebc124d2f9d637dd637d61750` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:43.481438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb4771-b641-46e7-8e5c-47f1c9fef0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=d775aea1464a40e2887ed69c25a34f58, role_id=fe934b3ebc124d2f9d637dd637d61750)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:43.483082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb4771-b641-46e7-8e5c-47f1c9fef0a1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:43.497141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 610/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 13:01:43 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/d775aea1464a40e2887ed69c25a34f58/roles/fe934b3ebc124d2f9d637dd637d61750 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:01:45.781927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33e3b8-965e-4572-bd0f-ba9fe9ed831b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:45.782455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33e3b8-965e-4572-bd0f-ba9fe9ed831b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:45.782554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33e3b8-965e-4572-bd0f-ba9fe9ed831b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:45.784225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 623/1233] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:45.790010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:45.790461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:45.790712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:45.808209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:45.809429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:45.883585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 611/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:45.907968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33e3b8-965e-4572-bd0f-ba9fe9ed831b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:45.937277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:46.022021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33e3b8-965e-4572-bd0f-ba9fe9ed831b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:46.064422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:46.065398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:46.065755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:46.066109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:46.077536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:01:46.086259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:46.087546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:46.088486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 624/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jun 7 13:01:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:46.094155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:46.143672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:46.204239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846d86-8717-4ebb-91a4-81d86699b477 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:46.242948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:46.243840 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:46.244348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:46.244627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:46.245724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:46.245965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:46.247587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:46.258459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 612/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jun 7 13:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:46.264357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:46.359171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:46.375623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071572d5-6e38-45c8-b8ee-782472c08771 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:46.415486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:46.416171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:46.416514 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:46.416963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:46.435024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:46.436747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:46.458169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:46.459322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:46.460526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:46.460526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:46.460526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:46.460526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:46.460526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 625/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:46.465863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:46.576723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744ffa-a3bc-47f6-a5dc-09bb69fd77a9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:46.588541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:46.618402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:46.619092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:46.619458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:46.619738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:46.620467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:46.620834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:46.622308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:46.635371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 613/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:46.642665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:46.759782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556b57-aa43-4eec-9126-b8dcf857a4e7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:46.798268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:46.799191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:46.799500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:46.799852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:46.802839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:46.808591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:46.810619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 13:01:46.826208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:46.827385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:46.828624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 626/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:46.833906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:46.943850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1872-1997-4f32-b776-f3f0178c7b26 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:46.979983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:46.980674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:46.980952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:46.981254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:46.982115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:46.982425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:46.983874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:47.002025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 614/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jun 7 13:01:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:47.008191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:47.111948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a8f8a-a6a6-451e-9ab1-375a9ba7a8b9 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:47.159039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:47.159703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:47.160013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:47.160288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:47.230983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:47.240648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:47.242162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:47.352422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 627/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:01:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 13:01:47.358552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:47.389629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:47.472330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fa086-c536-4a80-a141-70de9d20db4d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:47.509631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:47.510532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:47.511684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:47.511684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:47.522079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:47.523523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:47.541781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:47.542914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:47.544115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:47.544115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:47.544115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:47.544115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:47.544115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 615/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:47.548775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:47.651002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:47.659225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73edb9a-fcba-4f8d-bf85-b6221f239f19 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:47.695464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:47.696218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:47.696580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:47.696886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:47.697741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:47.698125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:47.699698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:47.713581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 628/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:47.720390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:47.806503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:47.829721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22dff9-e166-42d6-b1b4-d15b44a63a5c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:47.868419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:47.869280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:47.869559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:47.869830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:47.879833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:47.881342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 13:01:47.895351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:47.896427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:47.897737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 616/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 13:01:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:47.903131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:48.006029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57700d8-8b40-4240-b704-66ac228119de None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:48.043637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:48.044333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:48.044662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:48.044987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:48.045910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:48.046161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:48.047632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab43834-f361-4840-8b59-576f55d1d08e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:48.061460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 629/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 13:01:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:48.067763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:48.181804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cbc62-495d-4b92-99c0-9045b9e1de65 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:48.218677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:48.219441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:48.219721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:48.220124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:48.220955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] RBAC: Adding query filter params (role.id=fe934b3ebc124d2f9d637dd637d61750, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=d775aea1464a40e2887ed69c25a34f58) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:48.221423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:48.223033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57025f65-c61c-4124-b3f5-f73448fdc6b0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:48.229792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 617/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:01:48 2022] GET /identity/v3/role_assignments?user.id=d775aea1464a40e2887ed69c25a34f58&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=fe934b3ebc124d2f9d637dd637d61750 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:50.690905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb7af-c994-4e78-b942-ea3beb374386 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:50.691636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb7af-c994-4e78-b942-ea3beb374386 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:50.691796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb7af-c994-4e78-b942-ea3beb374386 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:50.693346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 630/1247] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:50.699693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:50.700535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:50.700535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:50.706397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:50.720620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:50.722051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:50.802468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 618/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:50.827405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cb7af-c994-4e78-b942-ea3beb374386 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:50.853533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:50.969285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cb7af-c994-4e78-b942-ea3beb374386 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:51.016634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:51.017551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:51.017834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:51.018106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:51.031347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:01:51.043364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:51.044364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:51.048740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 631/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:01:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:51.051715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:51.167717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f234f-234a-44cf-bede-18df3ce2caec None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:51.206653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:51.212440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:51.213228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:51.213516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:51.213874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:51.214652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:51.215050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:51.216481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:51.226399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 619/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:51.232238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:51.327685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:51.356635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0421d-7d49-4048-ab12-4aaf73b8af8e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:51.404587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:51.406029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:51.406265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:51.406641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:51.426000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:51.427513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:51.448946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:51.449976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:51.450916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:51.450916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:51.450916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:51.450916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:51.451138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 632/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 13:01:51.457577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:51.596831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c308-a089-4f22-abb9-4fbc74c75616 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:51.633648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:51.634475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:51.634744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:51.635035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:51.635893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:51.636198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:51.637603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:51.650494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 620/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:01:51.656520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:51.766610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a709ed-9390-4512-95b8-c9ff528149c7 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:51.796048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:51.806149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:51.807193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:51.807448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:51.807742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:51.817064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:51.818798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 13:01:51.836227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:51.837562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:51.843622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 633/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:51.844349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:51.908076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:51.956414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b07bc-d862-4cd5-a635-3ce253f4d728 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:51.995993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:51.996699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:51.997091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:51.997553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:51.999134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:51.999632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:52.001121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:52.020335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 621/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jun 7 13:01:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:52.027365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:52.143902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafce1f-fff4-4df9-a8a0-6a16535b8648 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:52.178211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:52.178799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:52.179090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:52.179353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:52.237362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:52.252411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:52.254124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:52.360813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 634/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:01:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:01:52.368991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:52.479803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5999d0-7a0b-4c6e-9a14-e85a340d0b26 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:52.493462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:52.516126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:52.516939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:52.517231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:52.517502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:52.528236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:52.529723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:52.547159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:52.548281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:52.549514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:52.549514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:52.549514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:52.549514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:52.553264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 622/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:52.554808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:52.647666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:52.659944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c577355-5726-4d13-ac66-5c2807a78642 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:52.697683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:52.698373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:52.698640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:52.698917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:52.699652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:52.699962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:52.701360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:52.713350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 635/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:01:52.719093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:52.828555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064346-230c-4c20-b496-fb970eb04596 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:52.864612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:52.865709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:52.866059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:52.866526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:52.874249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:52.875864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 13:01:52.890562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:52.891638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:01:52.898347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 623/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 13:01:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:52.898950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:53.011039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688dddd-250b-418c-8113-53112e8fc2c0 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:53.049602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:53.050286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:53.050697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:53.051024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:53.051782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:53.052089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:53.053599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b703-567c-4bd2-be54-36633aacb89d None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:53.067314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 636/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 13:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:53.073720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:53.102989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:53.189542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c8bd-81b3-4ce9-95a7-cec4b4b047aa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:53.228671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:53.229380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:53.229658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:53.229936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:53.230806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=d775aea1464a40e2887ed69c25a34f58) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:53.231123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:53.232591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790f23-bcb2-42f6-a096-ee191841727c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:53.240213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 624/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:01:53 2022] GET /identity/v3/role_assignments?user.id=d775aea1464a40e2887ed69c25a34f58&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=62f04dcd631e4206baea551a55948cbb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:55.516348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec425-edd9-4b83-b072-4584f27d04a8 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:55.516909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec425-edd9-4b83-b072-4584f27d04a8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:55.516909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec425-edd9-4b83-b072-4584f27d04a8 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:55.518336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 637/1261] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:55.524225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:55.524635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:55.524801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:55.543506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:55.544695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:55.615583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 625/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:55.639319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec425-edd9-4b83-b072-4584f27d04a8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:55.657898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:55.760537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec425-edd9-4b83-b072-4584f27d04a8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:55.797971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:55.798686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:55.798965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:55.799230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:55.810207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:01:55.817734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:55.818760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:55.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 638/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:55.828021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:55.854069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:55.938250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9353c-f9c2-405f-9ac7-0565b0168092 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:55.974451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:55.975123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:55.975401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:55.975671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:55.976430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:55.976736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:55.978154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:55.986503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 626/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:55.993293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:56.081158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:56.126515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb86f-b712-431a-80b5-0df3497de4eb None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:56.164240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:56.165149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:56.165431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:56.165706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:56.178053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:56.179548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:56.196989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:56.197980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:56.199152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:56.199152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:56.199152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:56.199152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:56.199152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 639/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:56.207203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:56.288998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:56.310173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c15b75-6052-4e76-aa7c-be275bcf2661 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:56.348224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:56.348815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:56.349127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:56.349400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:56.350127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:56.350435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:56.351796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:56.363736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 627/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:56.370327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:56.500869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21627-674f-40ed-a82f-210677d5a220 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:56.522029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:56.540507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:56.541428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:56.541715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:56.541992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:56.549658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:56.551336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 13:01:56.565670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:56.566838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:56.568064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 640/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:56.573207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:56.692838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0997297-03df-44a3-814b-cec01e3b39c9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:56.730862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:56.731537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:56.731816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:56.732091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:56.732927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:56.733271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:56.734701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:56.744091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:56.753053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 628/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jun 7 13:01:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:56.760647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:56.869459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023148c-38c9-43c7-a621-84567e84a22f None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:56.908234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:56.909059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:56.909332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:56.909606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:56.921155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:56.922612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:01:56.939995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:56.940985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:56.942056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:01:56.942056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:01:56.942056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:01:56.942056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:56.945202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 641/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:56.947963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:57.058806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173e49-bcc0-45b3-932c-e676ca659b8b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:57.094440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:57.095097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:57.095374 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:57.095642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:57.096366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:57.096670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:57.098256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:57.109530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 629/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:57.116839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:57.153918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:57.230958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71ca05-4635-4084-8f02-4ed393a8d866 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:57.265246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:57.266035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:57.266315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:57.266586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:57.273754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:57.275210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 13:01:57.289611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:01:57.290606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:01:57.291750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 642/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 13:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:01:57.296995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:57.357943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:57.408648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fccd4d-3781-4b13-b296-e5dee6c777f3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:57.444445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:57.445135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:57.445416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:57.445685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:57.446482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:01:57.446790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:57.448217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2aea-1a44-493e-ba3f-5185fe9de912 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:57.460315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 630/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 13:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:01:57.466673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:01:57.561761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:01:57.572165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b069c3-5c1d-4808-aaa8-8a90adae25ee None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:01:57.609440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9655cd-2169-4e94-a261-527b0c32a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:01:57.610389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9655cd-2169-4e94-a261-527b0c32a70a None admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:57.610668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9655cd-2169-4e94-a261-527b0c32a70a None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:57.610943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9655cd-2169-4e94-a261-527b0c32a70a None admin] PATH_INFO: `/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/d775aea1464a40e2887ed69c25a34f58/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:57.613262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9655cd-2169-4e94-a261-527b0c32a70a None admin] RBAC: Authorizing `identity:create_grant(project_id=dbca9d5cfed849a2b4112de05e2fa2bd, user_id=d775aea1464a40e2887ed69c25a34f58, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:01:57.615072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9655cd-2169-4e94-a261-527b0c32a70a None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:01:57.631271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 643/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jun 7 13:01:57 2022] PUT /identity/v3/projects/dbca9d5cfed849a2b4112de05e2fa2bd/users/d775aea1464a40e2887ed69c25a34f58/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:01:59.858171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74d4c-3dd7-46d8-ac90-35247765cc06 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:59.859117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74d4c-3dd7-46d8-ac90-35247765cc06 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:59.859117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74d4c-3dd7-46d8-ac90-35247765cc06 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:59.861285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 631/1274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:01:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:01:59.867705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:01:59.868133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:01:59.868255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:01:59.886729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:01:59.887949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:01:59.966775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 644/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:01:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:01:59.999091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74d4c-3dd7-46d8-ac90-35247765cc06 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:00.121744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74d4c-3dd7-46d8-ac90-35247765cc06 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:00.140856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:00.159693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:00.160520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:00.160799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:00.161045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:00.172668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 13:02:00.180099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:00.181216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:00.182340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 632/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jun 7 13:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:00.189417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:00.277441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:00.301309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1c1d-3045-4887-a2bd-bc5b4ebb2c26 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:00.338028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:00.338688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:00.338968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:00.339236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:00.339963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:00.340300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:00.341688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:00.350157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 645/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jun 7 13:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:02:00.358975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:00.471076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45524400-2a1a-4183-bcc3-4a81d3d87b79 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:00.506080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:00.506878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:00.507159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:00.507439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:00.519595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:00.521054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:02:00.539868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:00.540902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:00.542280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:02:00.542280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:02:00.542280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:02:00.542280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:00.542280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 633/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:00.550418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:00.667518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790be9-4c15-4cc7-8bb2-0f11595bf791 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:00.707075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:00.707733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:00.708015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:00.708287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:00.709053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:00.709356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:00.710736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:00.722746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 646/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:00.728836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:00.765545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:00.836270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23390b-c1eb-4dcd-a8b1-1619a3965c34 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:00.871186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:00.871977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:00.872261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:00.872538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:00.880159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:00.881641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 13:02:00.895777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:00.897209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:00.898524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 634/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:02:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:00.904913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:00.908782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:01.028450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab6e6b-cef7-4852-ab22-e4ef9a9c99c1 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:01.064601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:01.065294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:01.065572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:01.065839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:01.066712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:01.067017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:01.068448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:01.094263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 647/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jun 7 13:02:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:02:01.101820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:01.193721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:01.204707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bbfcd-9c76-42e8-8959-356b7d1618d2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:01.243961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:01.244937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:01.245402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:01.245826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:01.325108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:01.326485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:01.419705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:01.430480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 635/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jun 7 13:02:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 13:02:01.439079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:01.506783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:01.548735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f139f-58c4-4676-a497-b2686a44632e None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:01.588186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:01.588919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:01.589273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:01.589542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:01.599969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:01.601477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 13:02:01.619604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:01.620596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:01.621708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 13:02:01.621708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 13:02:01.621708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 13:02:01.621708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:02:01.621708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 648/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:01.626626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:01.734911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4569-9925-489e-85b8-1183fb116c14 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:01.771860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:01.772514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:01.772795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:01.773078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:01.773829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:01.774133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:01.775519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:01.787182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 636/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jun 7 13:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:02:01.793273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:01.911090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e06ce-fb45-46ab-a290-a327fe025e0c None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:01.925088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:01.947479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:01.948289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:01.948571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:01.948845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:01.956607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:01.958226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 13:02:01.972631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:01.973754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: ERROR keystone.server.flask.application Jun 07 13:02:01.974817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 649/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jun 7 13:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:01.979975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:02.035483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:02.087878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7d22b-3770-4960-9bf9-de5c6c4d9b25 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:02.123151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:02.123814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:02.124045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:02.124356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:02.125184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:02.125496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:02.126922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b106db-2db2-47ea-bbde-ee4df2a09fd2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:02.139416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 637/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jun 7 13:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:02.146343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:02.260074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b338-10dd-460a-96ae-3ac372f4f9f5 None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:02.297528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:02.298173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:02.298454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:02.298719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:02.299549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] RBAC: Adding query filter params (role.id=62f04dcd631e4206baea551a55948cbb, scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd, user.id=d775aea1464a40e2887ed69c25a34f58) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:02.299854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:02.301517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b3b1f-69db-4ed6-acb1-27b3157242b2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:02.307532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 650/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jun 7 13:02:02 2022] GET /identity/v3/role_assignments?user.id=d775aea1464a40e2887ed69c25a34f58&scope.project.id=dbca9d5cfed849a2b4112de05e2fa2bd&role.id=62f04dcd631e4206baea551a55948cbb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:04.609729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea7fe-ecee-4ccb-8d4c-1ad90e694f04 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:04.610159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea7fe-ecee-4ccb-8d4c-1ad90e694f04 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:04.610279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea7fe-ecee-4ccb-8d4c-1ad90e694f04 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:04.611655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 638/1288] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:02:04.618691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:04.619359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:04.619559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:04.641237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:02:04.642435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:02:04.674483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:04.718346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 651/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:02:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:02:04.742747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea7fe-ecee-4ccb-8d4c-1ad90e694f04 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:04.853351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea7fe-ecee-4ccb-8d4c-1ad90e694f04 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:04.864335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:04.889737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:04.890537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:04.890817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:04.891090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:04.891747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:04.893145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:04.905888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:04.907083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:04.908328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 639/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 13:02:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:04.916810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:05.022778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb1eff-3c5e-4489-a8fc-149d882a4fa3 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:05.060378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:05.061052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:05.061336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:05.061607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:05.062321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:05.062627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:05.064008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d416-1be5-41c1-bcb8-b14b11fec38b None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:05.069001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 652/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jun 7 13:02:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:02:05.078171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:05.180182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1e30-ecb9-466b-b67d-39a78d92a681 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:05.217471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:05.218127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:05.218406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:05.218678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:05.219393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:05.219698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:05.221099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf445c-d9b4-4968-8b81-9641a448d081 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:05.225688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 640/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jun 7 13:02:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:07.447671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e612b-37e6-454c-aaf6-65d5f147c11a None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:07.448226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e612b-37e6-454c-aaf6-65d5f147c11a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:07.448226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e612b-37e6-454c-aaf6-65d5f147c11a None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:07.449653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 653/1293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:02:07.457840 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d1bc2-c0c8-4e63-a65a-c274d68c990b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:07.458259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d1bc2-c0c8-4e63-a65a-c274d68c990b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:07.458347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d1bc2-c0c8-4e63-a65a-c274d68c990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:07.475775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e66d1bc2-c0c8-4e63-a65a-c274d68c990b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:02:07.476960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e66d1bc2-c0c8-4e63-a65a-c274d68c990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:02:07.506415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:07.547451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 641/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:02:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:02:07.570804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e612b-37e6-454c-aaf6-65d5f147c11a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:07.608002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:07.709457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e612b-37e6-454c-aaf6-65d5f147c11a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:07.748151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9bb69-62d7-4810-819a-f5b8266a70c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:07.748823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9bb69-62d7-4810-819a-f5b8266a70c2 None admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:07.749135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9bb69-62d7-4810-819a-f5b8266a70c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:07.749418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9bb69-62d7-4810-819a-f5b8266a70c2 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:07.750147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9bb69-62d7-4810-819a-f5b8266a70c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:07.751539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9bb69-62d7-4810-819a-f5b8266a70c2 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:07.767373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 654/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jun 7 13:02:07 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:02:09.990503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cdf39-d06d-46ef-955c-84f0c808f506 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:09.991381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cdf39-d06d-46ef-955c-84f0c808f506 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:09.991381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cdf39-d06d-46ef-955c-84f0c808f506 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:09.993379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 642/1296] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:02:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:02:09.999780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:10.000508 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:10.000682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:10.022327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:02:10.023523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:02:10.105666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 655/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:02:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:02:10.137812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cdf39-d06d-46ef-955c-84f0c808f506 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:10.242958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cdf39-d06d-46ef-955c-84f0c808f506 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:10.281358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:10.282156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:10.282431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:10.282705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:10.283362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:10.284732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:10.297120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:10.298236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:10.299175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 643/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 13:02:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 13:02:10.305153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:10.324790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:10.406993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cb132-75ea-4a0f-9332-58af94a29dc0 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:10.440429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:10.441126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:10.441476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:10.441749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:10.442457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:10.442757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:10.444118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:10.449373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 656/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jun 7 13:02:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:10.457364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:10.493620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:10.565684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09d01-c1a7-4c5a-851b-7df7a00148e2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:10.602491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:10.603146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:10.603421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:10.603689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:10.604484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] RBAC: Adding query filter params (interface=public, service_id=f3a7a903e917496aaf196be2985c9395, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:10.604792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:10.606185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417ff4-547f-4f58-9721-a708b18204f6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:10.611585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 644/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jun 7 13:02:10 2022] GET /identity/v3/endpoints?service_id=f3a7a903e917496aaf196be2985c9395&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:10.620761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:10.711952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:10.732495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aba8c-f7d2-4ad3-aed1-e8de02c6ffdc None admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:10.771777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d6aa4-6328-41fa-acb4-f9f5fcc2e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:10.772382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6aa4-6328-41fa-acb4-f9f5fcc2e40e None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:10.772663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6aa4-6328-41fa-acb4-f9f5fcc2e40e None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:10.772938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6aa4-6328-41fa-acb4-f9f5fcc2e40e None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:10.773644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d6aa4-6328-41fa-acb4-f9f5fcc2e40e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:10.775014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d6aa4-6328-41fa-acb4-f9f5fcc2e40e None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:10.782502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 657/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jun 7 13:02:10 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:02:12.970802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24fff1-2c82-432d-88a6-d4fc2f526e13 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:12.971327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24fff1-2c82-432d-88a6-d4fc2f526e13 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:12.971327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24fff1-2c82-432d-88a6-d4fc2f526e13 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:12.972746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 645/1302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:02:12.979179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:12.979925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:12.980104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:13.006464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:02:13.007667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:02:13.076993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 658/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:02:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 13:02:13.100111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24fff1-2c82-432d-88a6-d4fc2f526e13 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:13.211287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:13.219340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24fff1-2c82-432d-88a6-d4fc2f526e13 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:13.256152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:13.256882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:13.257196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:13.257467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:13.258128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:13.259500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 13:02:13.271998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 13:02:13.273149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: ERROR keystone.server.flask.application Jun 07 13:02:13.274274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 646/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jun 7 13:02:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 13:02:13.280124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:13.365725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:13.397398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08388924-bea7-485e-8c60-db6b27452c35 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:13.447625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:13.448602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:13.448989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:13.449498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] PATH_INFO: `/v3/services` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:13.450631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:02:13.451069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:13.453248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81393-1d99-41c7-b3b9-40b77b9af2d3 None admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:13.460382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 659/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jun 7 13:02:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:02:13.469700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:02:13.583798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0f213-8dac-4b42-8925-9a0906f3a61c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:02:13.621461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb7300-d9fe-4983-ac2a-c62d67a80cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:02:13.622125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb7300-d9fe-4983-ac2a-c62d67a80cab None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:02:13.622411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb7300-d9fe-4983-ac2a-c62d67a80cab None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:02:13.622684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb7300-d9fe-4983-ac2a-c62d67a80cab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:02:13.623443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb7300-d9fe-4983-ac2a-c62d67a80cab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:02:13.624820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb7300-d9fe-4983-ac2a-c62d67a80cab None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:02:13.647116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 647/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jun 7 13:02:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:02:23.456566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=30 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:02:23.642291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:18.113938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207498-91fc-40b8-a2fb-dc65bc6ed594 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:18.114577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207498-91fc-40b8-a2fb-dc65bc6ed594 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:18.114577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207498-91fc-40b8-a2fb-dc65bc6ed594 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:18.116021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 660/1307] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 13:03:18.121275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4b5f-4665-415d-9344-860a6cc5e147 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:18.121720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4b5f-4665-415d-9344-860a6cc5e147 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:18.121802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4b5f-4665-415d-9344-860a6cc5e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:18.270147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f4ed4b5f-4665-415d-9344-860a6cc5e147 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:18.272784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f4ed4b5f-4665-415d-9344-860a6cc5e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:18.494387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 648/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:03:18.543022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575621b-c252-46b2-986d-41c2536fb976 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:18.543684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575621b-c252-46b2-986d-41c2536fb976 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:18.544232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575621b-c252-46b2-986d-41c2536fb976 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:18.545955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 661/1309] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jun 7 13:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:18.552974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e881-ab7f-4f2f-87fb-d47ef631b3e2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:18.553621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e881-ab7f-4f2f-87fb-d47ef631b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:18.554100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e881-ab7f-4f2f-87fb-d47ef631b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:18.640929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4595e881-ab7f-4f2f-87fb-d47ef631b3e2 None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:18.642844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4595e881-ab7f-4f2f-87fb-d47ef631b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:18.667307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:18.732175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 649/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jun 7 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:03:18.741443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575621b-c252-46b2-986d-41c2536fb976 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:18.743576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e575621b-c252-46b2-986d-41c2536fb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:18.862740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575621b-c252-46b2-986d-41c2536fb976 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:18.942728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:18.943649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:18.944087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:18.944510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:18.946395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:19.002814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:19.064014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:19.065862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b180d4-8bbf-4951-98d7-4aee3785b23e service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:19.090600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 662/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:21.635312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0eb72-5d0c-43da-9fbd-c5bc1e07bf20 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:21.635859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0eb72-5d0c-43da-9fbd-c5bc1e07bf20 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:21.635952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0eb72-5d0c-43da-9fbd-c5bc1e07bf20 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:21.637402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 650/1312] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:21.643228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e9ea-bb54-42d5-9f26-648aa4457a43 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:21.643741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e9ea-bb54-42d5-9f26-648aa4457a43 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:21.643821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e9ea-bb54-42d5-9f26-648aa4457a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:21.735048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8a80e9ea-bb54-42d5-9f26-648aa4457a43 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:21.736285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8a80e9ea-bb54-42d5-9f26-648aa4457a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:21.848786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 663/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:21.886168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0eb72-5d0c-43da-9fbd-c5bc1e07bf20 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:21.887756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-99d0eb72-5d0c-43da-9fbd-c5bc1e07bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:22.006885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0eb72-5d0c-43da-9fbd-c5bc1e07bf20 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:22.086560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:22.089644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:22.090273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:22.090551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:22.090826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:22.093071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:22.206720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:22.208159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02524f59-6b50-4e3d-b85a-a8a5c3245709 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:22.229215 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 651/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:24.779171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98030-004a-4ee7-9a2e-4133c9dc7f2c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:24.779733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98030-004a-4ee7-9a2e-4133c9dc7f2c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:24.779733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98030-004a-4ee7-9a2e-4133c9dc7f2c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:24.781134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 664/1315] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:24.787665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3670e-136b-41b5-a156-32e8db47b784 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:24.788128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3670e-136b-41b5-a156-32e8db47b784 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:24.788254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3670e-136b-41b5-a156-32e8db47b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:24.857926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d6a3670e-136b-41b5-a156-32e8db47b784 None None] MFA Rules not processed for user `6addd6a8b31d431899bd0115468c2933`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:24.859193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d6a3670e-136b-41b5-a156-32e8db47b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:24.914536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:24.965947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 652/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:25.006952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98030-004a-4ee7-9a2e-4133c9dc7f2c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:25.008511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cec98030-004a-4ee7-9a2e-4133c9dc7f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:25.019341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:25.139220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98030-004a-4ee7-9a2e-4133c9dc7f2c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:25.218301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:25.218944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:25.219222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:25.219488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:25.221255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:25.426091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:25.498467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:25.499914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8b05f-271d-4118-b7cc-6ec392aa847e service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:25.520701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 665/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:03:28.367130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004adc4e-4db9-4136-898b-d9d8054af9c7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:28.367606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004adc4e-4db9-4136-898b-d9d8054af9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:28.367699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004adc4e-4db9-4136-898b-d9d8054af9c7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:28.369089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 653/1318] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:28.375569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac06b6-8b6c-45bd-b1cf-5898745c24de None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:28.376011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac06b6-8b6c-45bd-b1cf-5898745c24de None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:28.376122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac06b6-8b6c-45bd-b1cf-5898745c24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:28.447183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d4ac06b6-8b6c-45bd-b1cf-5898745c24de None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:28.448389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d4ac06b6-8b6c-45bd-b1cf-5898745c24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:28.556093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 666/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:28.602724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004adc4e-4db9-4136-898b-d9d8054af9c7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:28.604770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-004adc4e-4db9-4136-898b-d9d8054af9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:28.724237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004adc4e-4db9-4136-898b-d9d8054af9c7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:28.806410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:28.807056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:28.807334 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:28.807599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:28.809283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:28.817400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:28.932798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:28.935110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6cd8-e5b8-4727-b21e-4fb2210e63f6 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:28.955276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 654/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:31.941047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8004-e505-46ee-bb03-26a15d3f47b6 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:31.941625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8004-e505-46ee-bb03-26a15d3f47b6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:31.941625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8004-e505-46ee-bb03-26a15d3f47b6 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:31.942884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 667/1321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:31.948378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6c8d-4d38-4caf-b065-f7cbc6dbbc5d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:31.948802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6c8d-4d38-4caf-b065-f7cbc6dbbc5d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:31.949071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6c8d-4d38-4caf-b065-f7cbc6dbbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:32.020742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-663f6c8d-4d38-4caf-b065-f7cbc6dbbc5d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:32.021985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-663f6c8d-4d38-4caf-b065-f7cbc6dbbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:32.083967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:32.125097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 655/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:32.162844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa8004-e505-46ee-bb03-26a15d3f47b6 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:32.164468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e1fa8004-e505-46ee-bb03-26a15d3f47b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:32.185631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:32.277621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa8004-e505-46ee-bb03-26a15d3f47b6 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:32.356674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:32.357379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:32.357660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:32.357944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:32.359625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:32.437054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:32.475633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:32.477106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f573e-d02c-45d4-ab9e-34bd4e7ae6ca service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:32.495214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 668/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:34.774743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ed1e-c3db-4c0b-9217-df8dd442c647 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:34.775396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ed1e-c3db-4c0b-9217-df8dd442c647 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:34.775396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ed1e-c3db-4c0b-9217-df8dd442c647 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:34.777392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 656/1324] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:34.785375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978594-01ce-4c14-9b53-12f8e80ebc77 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:34.785822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978594-01ce-4c14-9b53-12f8e80ebc77 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:34.785899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978594-01ce-4c14-9b53-12f8e80ebc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:34.850211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-db978594-01ce-4c14-9b53-12f8e80ebc77 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:34.851404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-db978594-01ce-4c14-9b53-12f8e80ebc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:34.953684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 669/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:35.003653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a67ab-b046-4fe6-bf07-35decc10fb49 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:35.003941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a67ab-b046-4fe6-bf07-35decc10fb49 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:35.004225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a67ab-b046-4fe6-bf07-35decc10fb49 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:35.005684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 657/1326] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jun 7 13:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:35.011865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfdbbb-b52a-4418-8ee5-585add050f29 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:35.012114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfdbbb-b52a-4418-8ee5-585add050f29 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:35.012418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfdbbb-b52a-4418-8ee5-585add050f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:35.044555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:35.090068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-29dfdbbb-b52a-4418-8ee5-585add050f29 None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:35.091278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-29dfdbbb-b52a-4418-8ee5-585add050f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:35.168532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 670/1327] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jun 7 13:03:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:35.178080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a67ab-b046-4fe6-bf07-35decc10fb49 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:35.179651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5e0a67ab-b046-4fe6-bf07-35decc10fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:35.285823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a67ab-b046-4fe6-bf07-35decc10fb49 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:35.363637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:35.364344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:35.364617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:35.364887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:35.366581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:35.384131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:35.482798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:35.484251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7ed56-6dd2-405e-81be-27f2b06befa3 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:35.503679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 658/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:38.045614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd0d6-3650-402d-89cb-38143c9110b3 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:38.046127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd0d6-3650-402d-89cb-38143c9110b3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:38.046127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd0d6-3650-402d-89cb-38143c9110b3 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:38.047592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 671/1329] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:38.053109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f8855-6fc9-4e77-a0f8-75174907fb84 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:38.053567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f8855-6fc9-4e77-a0f8-75174907fb84 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:38.053655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f8855-6fc9-4e77-a0f8-75174907fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:38.121621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-187f8855-6fc9-4e77-a0f8-75174907fb84 None None] MFA Rules not processed for user `6addd6a8b31d431899bd0115468c2933`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:38.122839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-187f8855-6fc9-4e77-a0f8-75174907fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:38.192177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:38.225453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 659/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:38.263114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd0d6-3650-402d-89cb-38143c9110b3 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:38.264655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-956fd0d6-3650-402d-89cb-38143c9110b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:38.372598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd0d6-3650-402d-89cb-38143c9110b3 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:38.393516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:38.452558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:38.453252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:38.453531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:38.453802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:38.455476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:38.567591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:38.569051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ae1a7-c3d7-4fa5-a22e-673990e0409d service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:38.591554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 672/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:41.306157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb34b3-a73d-47a0-8256-ebb316e530f1 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:41.306699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb34b3-a73d-47a0-8256-ebb316e530f1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:41.306798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb34b3-a73d-47a0-8256-ebb316e530f1 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:41.308135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 660/1332] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:41.314208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273167ac-5918-42c7-80c2-68df41d1c2f7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:41.314851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273167ac-5918-42c7-80c2-68df41d1c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:41.314851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273167ac-5918-42c7-80c2-68df41d1c2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:41.382265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:41.385410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-273167ac-5918-42c7-80c2-68df41d1c2f7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:41.387080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-273167ac-5918-42c7-80c2-68df41d1c2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:41.486976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 673/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:41.523147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb34b3-a73d-47a0-8256-ebb316e530f1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:41.524700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1ebb34b3-a73d-47a0-8256-ebb316e530f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:41.631736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb34b3-a73d-47a0-8256-ebb316e530f1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:41.706989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:41.707570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:41.707849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:41.708121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:41.709804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:41.737815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:41.827230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:41.828687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88c9d-6077-4986-ba92-5a75fa4170cc service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:41.847541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 661/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:44.150773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a9f1-5934-41e2-b438-0d8fff46e489 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:44.151741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a9f1-5934-41e2-b438-0d8fff46e489 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:44.151741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a9f1-5934-41e2-b438-0d8fff46e489 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:44.153848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 674/1335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:44.162923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b708ee0-56df-4207-8db1-128dbace209d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:44.163647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b708ee0-56df-4207-8db1-128dbace209d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:44.163794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b708ee0-56df-4207-8db1-128dbace209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:44.236987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2b708ee0-56df-4207-8db1-128dbace209d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:44.238214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2b708ee0-56df-4207-8db1-128dbace209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:44.329859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:44.353848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 662/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:44.394153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982a9f1-5934-41e2-b438-0d8fff46e489 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:44.395719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1982a9f1-5934-41e2-b438-0d8fff46e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:44.505352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982a9f1-5934-41e2-b438-0d8fff46e489 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:44.536336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:44.582361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:44.583014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:44.583294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:44.583563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:44.585240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:44.708276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:44.710452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bdb45-ef9d-4a6e-aecc-9802c4caff17 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:44.733420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 675/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:47.410806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f99b-ead1-4702-96f7-752a14af4b3b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:47.411388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f99b-ead1-4702-96f7-752a14af4b3b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:47.411388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f99b-ead1-4702-96f7-752a14af4b3b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:47.413116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 663/1338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:47.418686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0704c-6d3d-4e93-99c9-6047b1d0bafb None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:47.419130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0704c-6d3d-4e93-99c9-6047b1d0bafb None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:47.419276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0704c-6d3d-4e93-99c9-6047b1d0bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:47.493610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9cb0704c-6d3d-4e93-99c9-6047b1d0bafb None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:47.494826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9cb0704c-6d3d-4e93-99c9-6047b1d0bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:47.503343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:47.599129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 676/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:47.636749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80f99b-ead1-4702-96f7-752a14af4b3b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:47.638493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8d80f99b-ead1-4702-96f7-752a14af4b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:47.777004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80f99b-ead1-4702-96f7-752a14af4b3b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:47.858131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:47.858776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:47.859053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:47.859320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:47.861219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:47.897215 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:47.974736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:47.976202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f004f4-7d6f-4f6a-8409-8ed0577724e2 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:48.002571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 664/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:52.328467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd6c0-deaf-4a71-acb2-9a8888a8d3b9 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:52.329080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd6c0-deaf-4a71-acb2-9a8888a8d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:52.329759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd6c0-deaf-4a71-acb2-9a8888a8d3b9 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:52.331628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 677/1341] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:52.337556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30223a-d102-4ef5-977b-ee42625cc5bb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:52.338051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30223a-d102-4ef5-977b-ee42625cc5bb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:52.338140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30223a-d102-4ef5-977b-ee42625cc5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:52.424445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3c30223a-d102-4ef5-977b-ee42625cc5bb None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:52.425601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3c30223a-d102-4ef5-977b-ee42625cc5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:52.521744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:52.535413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 665/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:03:52.573687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd6c0-deaf-4a71-acb2-9a8888a8d3b9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:52.576002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ca6bd6c0-deaf-4a71-acb2-9a8888a8d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:52.679577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd6c0-deaf-4a71-acb2-9a8888a8d3b9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:52.683400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c976abf-4b69-45e6-a672-f00af57cda86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:52.684070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c976abf-4b69-45e6-a672-f00af57cda86 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:52.684334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c976abf-4b69-45e6-a672-f00af57cda86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:52.684606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c976abf-4b69-45e6-a672-f00af57cda86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:52.694466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c976abf-4b69-45e6-a672-f00af57cda86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:52.695934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c976abf-4b69-45e6-a672-f00af57cda86 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:52.705830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 678/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:03:55.733656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c5143-e9c8-40f1-ae13-c436fc5ff9dd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:55.734247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c5143-e9c8-40f1-ae13-c436fc5ff9dd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:55.734247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c5143-e9c8-40f1-ae13-c436fc5ff9dd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:55.735931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 666/1344] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:03:55.741494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead395-58c3-4602-a6d3-be625f31abff None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:55.741914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead395-58c3-4602-a6d3-be625f31abff None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:55.742071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead395-58c3-4602-a6d3-be625f31abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:55.772382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-4fead395-58c3-4602-a6d3-be625f31abff None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:03:55.773622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4fead395-58c3-4602-a6d3-be625f31abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:55.805161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:03:55.858014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 679/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:03:55.895922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c5143-e9c8-40f1-ae13-c436fc5ff9dd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:03:55.898053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9e5c5143-e9c8-40f1-ae13-c436fc5ff9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:03:55.913134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c5143-e9c8-40f1-ae13-c436fc5ff9dd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:03:55.916945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338e8f7-20cf-4a02-8119-dfef32fc3668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:03:55.917750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338e8f7-20cf-4a02-8119-dfef32fc3668 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:03:55.918037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338e8f7-20cf-4a02-8119-dfef32fc3668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:03:55.918312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338e8f7-20cf-4a02-8119-dfef32fc3668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:03:55.928321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338e8f7-20cf-4a02-8119-dfef32fc3668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:03:55.930346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338e8f7-20cf-4a02-8119-dfef32fc3668 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:03:55.941363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 667/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:03:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:04:00.235628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fa81c-d08c-4462-8406-8bed135ea5a9 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:00.236186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fa81c-d08c-4462-8406-8bed135ea5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:00.236394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fa81c-d08c-4462-8406-8bed135ea5a9 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:00.237810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 680/1347] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:00.243095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371048a0-1480-400a-bcec-3435daa68927 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:00.243551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371048a0-1480-400a-bcec-3435daa68927 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:00.243646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371048a0-1480-400a-bcec-3435daa68927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:00.262168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-371048a0-1480-400a-bcec-3435daa68927 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:00.263348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-371048a0-1480-400a-bcec-3435daa68927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:00.272019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 668/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:00.309240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fa81c-d08c-4462-8406-8bed135ea5a9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:00.321278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fa81c-d08c-4462-8406-8bed135ea5a9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:00.325134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a47ae-b5a2-485a-8fff-0927be8ac548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:00.325758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a47ae-b5a2-485a-8fff-0927be8ac548 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:00.326041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a47ae-b5a2-485a-8fff-0927be8ac548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:00.326313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a47ae-b5a2-485a-8fff-0927be8ac548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:00.335920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a47ae-b5a2-485a-8fff-0927be8ac548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:00.337417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a47ae-b5a2-485a-8fff-0927be8ac548 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:00.347445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 681/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:05.718611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565553b-3deb-4637-8bff-639c252e7b51 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:05.719158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565553b-3deb-4637-8bff-639c252e7b51 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:05.719266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565553b-3deb-4637-8bff-639c252e7b51 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:05.720881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 669/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:05.726010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aed43-8be1-47e4-a28e-47f0ca9cb43f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:05.726420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aed43-8be1-47e4-a28e-47f0ca9cb43f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:05.726563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aed43-8be1-47e4-a28e-47f0ca9cb43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:05.800003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e70aed43-8be1-47e4-a28e-47f0ca9cb43f None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:05.801256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e70aed43-8be1-47e4-a28e-47f0ca9cb43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:05.895958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 682/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:04:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:10.256895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=13 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:10.377721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93baaa7-d82a-497e-a676-dcbf5a38346c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:10.378006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93baaa7-d82a-497e-a676-dcbf5a38346c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:10.378281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93baaa7-d82a-497e-a676-dcbf5a38346c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:10.379886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 670/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:10.384904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251b58-5c77-48bb-95ad-05fdd0f9e7b5 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:10.385806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251b58-5c77-48bb-95ad-05fdd0f9e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:10.386224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251b58-5c77-48bb-95ad-05fdd0f9e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:10.405477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-77251b58-5c77-48bb-95ad-05fdd0f9e7b5 None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:10.406858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-77251b58-5c77-48bb-95ad-05fdd0f9e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:10.416439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 683/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:11.842207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69f22-1dca-4a4f-b214-846f47482a7a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:11.842845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69f22-1dca-4a4f-b214-846f47482a7a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:11.842845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69f22-1dca-4a4f-b214-846f47482a7a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:11.844404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 671/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:11.850083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52907-b97c-432a-9f6d-f05bebc7701a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:11.850658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52907-b97c-432a-9f6d-f05bebc7701a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:11.850658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52907-b97c-432a-9f6d-f05bebc7701a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:11.870777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8dc52907-b97c-432a-9f6d-f05bebc7701a None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:11.871905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8dc52907-b97c-432a-9f6d-f05bebc7701a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:11.882021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 684/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:15.712358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3fcb-86e6-4e02-932a-fd71bc35d2db None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:15.712870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3fcb-86e6-4e02-932a-fd71bc35d2db None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:15.712870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3fcb-86e6-4e02-932a-fd71bc35d2db None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:15.714740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 672/1356] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:15.720351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5706a0e-6928-464f-8705-6beb64e10413 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:15.720744 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5706a0e-6928-464f-8705-6beb64e10413 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:15.720907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5706a0e-6928-464f-8705-6beb64e10413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:15.740169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b5706a0e-6928-464f-8705-6beb64e10413 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:15.741549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b5706a0e-6928-464f-8705-6beb64e10413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:15.750065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 685/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:15.805125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fcc43-b010-4ff9-ba7a-41df39780568 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:15.805655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fcc43-b010-4ff9-ba7a-41df39780568 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:15.806066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fcc43-b010-4ff9-ba7a-41df39780568 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:15.807872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 673/1358] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jun 7 13:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:15.819134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a79d67-3a45-4eac-95d6-e1d911d8e102 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:15.819704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a79d67-3a45-4eac-95d6-e1d911d8e102 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:15.820504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a79d67-3a45-4eac-95d6-e1d911d8e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:15.865284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:15.874779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-79a79d67-3a45-4eac-95d6-e1d911d8e102 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:15.876564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-79a79d67-3a45-4eac-95d6-e1d911d8e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:15.967586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 686/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jun 7 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:04:15.976070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fcc43-b010-4ff9-ba7a-41df39780568 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:15.991867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fcc43-b010-4ff9-ba7a-41df39780568 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:15.997362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368aa6c-28ba-4f18-8505-536ace4ade2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:15.998085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368aa6c-28ba-4f18-8505-536ace4ade2a service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:15.998457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368aa6c-28ba-4f18-8505-536ace4ade2a service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:15.998798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368aa6c-28ba-4f18-8505-536ace4ade2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:16.007774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368aa6c-28ba-4f18-8505-536ace4ade2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:16.009484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368aa6c-28ba-4f18-8505-536ace4ade2a service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:16.019813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 674/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:18.503621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456a12-f21e-42fb-9b4e-ff9d9c05c0a3 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:18.504203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456a12-f21e-42fb-9b4e-ff9d9c05c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:18.504203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456a12-f21e-42fb-9b4e-ff9d9c05c0a3 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:18.505782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 687/1361] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:18.511259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d7cf-5c73-45d3-ad1a-1263fd7540de None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:18.512515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d7cf-5c73-45d3-ad1a-1263fd7540de None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:18.513185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d7cf-5c73-45d3-ad1a-1263fd7540de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:18.533495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3077d7cf-5c73-45d3-ad1a-1263fd7540de None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:18.534657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3077d7cf-5c73-45d3-ad1a-1263fd7540de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:18.545379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 675/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:18.588431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456a12-f21e-42fb-9b4e-ff9d9c05c0a3 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:18.607203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456a12-f21e-42fb-9b4e-ff9d9c05c0a3 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:18.613267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc3e2-2b6a-4927-8af6-e5619823f20a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:18.614131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc3e2-2b6a-4927-8af6-e5619823f20a service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:18.614424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc3e2-2b6a-4927-8af6-e5619823f20a service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:18.614703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc3e2-2b6a-4927-8af6-e5619823f20a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:18.623972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc3e2-2b6a-4927-8af6-e5619823f20a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:18.625690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc3e2-2b6a-4927-8af6-e5619823f20a service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:18.636264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 688/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:21.229360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ead03-c984-4052-8a8f-952595c94de1 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:21.229937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ead03-c984-4052-8a8f-952595c94de1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:21.229937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ead03-c984-4052-8a8f-952595c94de1 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:21.231277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 676/1364] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:21.236937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53729-1dc9-4666-8319-ddc180eab379 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:21.237467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53729-1dc9-4666-8319-ddc180eab379 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:21.237553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53729-1dc9-4666-8319-ddc180eab379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:21.262118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-bed53729-1dc9-4666-8319-ddc180eab379 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:21.263329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bed53729-1dc9-4666-8319-ddc180eab379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:21.272304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 689/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:21.318304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82939-1617-4957-86c9-78c8c1279a97 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:21.318590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82939-1617-4957-86c9-78c8c1279a97 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:21.318875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82939-1617-4957-86c9-78c8c1279a97 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:21.320247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 677/1366] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jun 7 13:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:21.325511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9f945-c709-4fda-a9fa-6feaef122cdf None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:21.325796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9f945-c709-4fda-a9fa-6feaef122cdf None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:21.326071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9f945-c709-4fda-a9fa-6feaef122cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:21.345258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-acb9f945-c709-4fda-a9fa-6feaef122cdf None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:21.346630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-acb9f945-c709-4fda-a9fa-6feaef122cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:21.356805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 690/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jun 7 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:21.365128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82939-1617-4957-86c9-78c8c1279a97 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:21.379903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82939-1617-4957-86c9-78c8c1279a97 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:21.385717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff9f2a-b3e3-4e1c-bf10-cf4eedbe2b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:21.386403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff9f2a-b3e3-4e1c-bf10-cf4eedbe2b5c service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:21.386673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff9f2a-b3e3-4e1c-bf10-cf4eedbe2b5c service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:21.386950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff9f2a-b3e3-4e1c-bf10-cf4eedbe2b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:21.395649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff9f2a-b3e3-4e1c-bf10-cf4eedbe2b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:21.397293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff9f2a-b3e3-4e1c-bf10-cf4eedbe2b5c service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:21.407519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 678/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:23.709060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aeea0-1da6-4b68-9334-e2c8d3753380 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:23.709695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aeea0-1da6-4b68-9334-e2c8d3753380 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:23.709695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aeea0-1da6-4b68-9334-e2c8d3753380 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:23.710987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 691/1369] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 13:04:23.716480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabc8dc-3636-4e05-8402-04748a49df10 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:23.716935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabc8dc-3636-4e05-8402-04748a49df10 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:23.717067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabc8dc-3636-4e05-8402-04748a49df10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:23.735647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2eabc8dc-3636-4e05-8402-04748a49df10 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:23.737054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2eabc8dc-3636-4e05-8402-04748a49df10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:23.746182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 679/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:04:23.792395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aeea0-1da6-4b68-9334-e2c8d3753380 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:23.807507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aeea0-1da6-4b68-9334-e2c8d3753380 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:23.814530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fb4e5-dd00-4500-8cfb-50d72d83d9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:23.815486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fb4e5-dd00-4500-8cfb-50d72d83d9dd service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:23.815990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fb4e5-dd00-4500-8cfb-50d72d83d9dd service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:23.816465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fb4e5-dd00-4500-8cfb-50d72d83d9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:23.826392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fb4e5-dd00-4500-8cfb-50d72d83d9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:23.828531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fb4e5-dd00-4500-8cfb-50d72d83d9dd service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:23.839922 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 692/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:23.964758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e531-5417-4ecd-8caa-c38fccd15e61 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:23.965357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e531-5417-4ecd-8caa-c38fccd15e61 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:23.965789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e531-5417-4ecd-8caa-c38fccd15e61 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:23.973656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 680/1372] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:23.974047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58788-c836-42ed-952e-ac7eb5beb4e0 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:23.974350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58788-c836-42ed-952e-ac7eb5beb4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:23.974632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58788-c836-42ed-952e-ac7eb5beb4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:23.995616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-79e58788-c836-42ed-952e-ac7eb5beb4e0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:23.997196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-79e58788-c836-42ed-952e-ac7eb5beb4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:24.005768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 693/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:04:24.310639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901956-af87-4617-b73d-2e8baa09d1fa None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:24.311053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901956-af87-4617-b73d-2e8baa09d1fa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:24.311853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901956-af87-4617-b73d-2e8baa09d1fa None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:24.313487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 681/1374] 10.222.0.20 () {54 vars in 963 bytes} [Tue Jun 7 13:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 13:04:24.318663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624790c-d614-488c-94ee-3d3f68f718a1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:24.319046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624790c-d614-488c-94ee-3d3f68f718a1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:24.319417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624790c-d614-488c-94ee-3d3f68f718a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:24.373207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9624790c-d614-488c-94ee-3d3f68f718a1 None None] MFA Rules not processed for user `82194f91a6fb4600988755c126818b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:24.374608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9624790c-d614-488c-94ee-3d3f68f718a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:24.447716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 694/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Tue Jun 7 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:24.456771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61901956-af87-4617-b73d-2e8baa09d1fa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:24.469700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61901956-af87-4617-b73d-2e8baa09d1fa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:24.473672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a731b-699d-4c11-bfd6-15ef85ae40de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:24.474629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a731b-699d-4c11-bfd6-15ef85ae40de service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:24.475035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a731b-699d-4c11-bfd6-15ef85ae40de service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:24.475537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a731b-699d-4c11-bfd6-15ef85ae40de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:24.486307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a731b-699d-4c11-bfd6-15ef85ae40de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:24.487874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a731b-699d-4c11-bfd6-15ef85ae40de service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:24.499202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 682/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:26.117216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507b3c-d7cd-4486-a137-f9bd88110ee8 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:26.117782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507b3c-d7cd-4486-a137-f9bd88110ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:26.117782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507b3c-d7cd-4486-a137-f9bd88110ee8 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:26.120432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 695/1377] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:26.128718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968967c-553e-4a2c-81e7-efbe9eca99d0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:26.129185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968967c-553e-4a2c-81e7-efbe9eca99d0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:26.129331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968967c-553e-4a2c-81e7-efbe9eca99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:26.149049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4968967c-553e-4a2c-81e7-efbe9eca99d0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:26.150249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4968967c-553e-4a2c-81e7-efbe9eca99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:26.158407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 683/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:26.212387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507b3c-d7cd-4486-a137-f9bd88110ee8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:26.227925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507b3c-d7cd-4486-a137-f9bd88110ee8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:26.233777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ce371-61da-4b82-90c6-0e004aa14d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:26.234454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ce371-61da-4b82-90c6-0e004aa14d76 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:26.234735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ce371-61da-4b82-90c6-0e004aa14d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:26.235012 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ce371-61da-4b82-90c6-0e004aa14d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:26.244833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ce371-61da-4b82-90c6-0e004aa14d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:26.246505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ce371-61da-4b82-90c6-0e004aa14d76 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:26.250990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:26.258481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 696/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:28.607373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d97c5-393d-4216-8bcc-5a7f8ea95966 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:28.608518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d97c5-393d-4216-8bcc-5a7f8ea95966 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:28.608952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d97c5-393d-4216-8bcc-5a7f8ea95966 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:28.613991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 684/1380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:28.616115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea73e-95bd-4df6-9e56-0a5f3dbfc9ae None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:28.616528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea73e-95bd-4df6-9e56-0a5f3dbfc9ae None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:28.616667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea73e-95bd-4df6-9e56-0a5f3dbfc9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:28.634626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f26ea73e-95bd-4df6-9e56-0a5f3dbfc9ae None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:28.635820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f26ea73e-95bd-4df6-9e56-0a5f3dbfc9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:28.644208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 697/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:28.689225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d97c5-393d-4216-8bcc-5a7f8ea95966 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:28.705061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d97c5-393d-4216-8bcc-5a7f8ea95966 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:28.711413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b1192-ad0a-4801-81be-8746b505e0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:28.712122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b1192-ad0a-4801-81be-8746b505e0dc service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:28.712406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b1192-ad0a-4801-81be-8746b505e0dc service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:28.712673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b1192-ad0a-4801-81be-8746b505e0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:28.722774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b1192-ad0a-4801-81be-8746b505e0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:28.724471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b1192-ad0a-4801-81be-8746b505e0dc service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:28.735321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 685/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:31.022024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265e8cd-0569-47f8-8383-692de7092f61 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:31.022636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265e8cd-0569-47f8-8383-692de7092f61 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:31.022636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265e8cd-0569-47f8-8383-692de7092f61 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:31.024174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 698/1383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:31.029642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448fd0-c8f7-4384-a097-e9ede592ff82 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:31.030473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448fd0-c8f7-4384-a097-e9ede592ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:31.030473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448fd0-c8f7-4384-a097-e9ede592ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:31.194952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-25448fd0-c8f7-4384-a097-e9ede592ff82 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:31.196036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-25448fd0-c8f7-4384-a097-e9ede592ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:31.205532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 686/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:31.247976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265e8cd-0569-47f8-8383-692de7092f61 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:31.263246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265e8cd-0569-47f8-8383-692de7092f61 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:31.269464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c474a-320e-4f70-95c8-4af19b4035e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:31.270107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c474a-320e-4f70-95c8-4af19b4035e2 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:31.270372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c474a-320e-4f70-95c8-4af19b4035e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:31.270816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c474a-320e-4f70-95c8-4af19b4035e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:31.280469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c474a-320e-4f70-95c8-4af19b4035e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:31.281916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c474a-320e-4f70-95c8-4af19b4035e2 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:31.293457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 699/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:33.568211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c98c2-97d2-4964-9527-207f980eab48 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:33.568811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c98c2-97d2-4964-9527-207f980eab48 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:33.568811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c98c2-97d2-4964-9527-207f980eab48 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:33.570229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 687/1386] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:33.575770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c006215-20ee-4f78-8f4c-9e6f22fec53b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:33.576238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c006215-20ee-4f78-8f4c-9e6f22fec53b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:33.576360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c006215-20ee-4f78-8f4c-9e6f22fec53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:33.596728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-4c006215-20ee-4f78-8f4c-9e6f22fec53b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:33.598041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4c006215-20ee-4f78-8f4c-9e6f22fec53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:33.607044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 700/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:33.654139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c98c2-97d2-4964-9527-207f980eab48 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:33.673360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c98c2-97d2-4964-9527-207f980eab48 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:33.680824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3867-a1f9-4562-99d2-3c3466549061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:33.682127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3867-a1f9-4562-99d2-3c3466549061 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:33.682734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3867-a1f9-4562-99d2-3c3466549061 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:33.683088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3867-a1f9-4562-99d2-3c3466549061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:33.694441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3867-a1f9-4562-99d2-3c3466549061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:33.696172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3867-a1f9-4562-99d2-3c3466549061 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:33.709069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 688/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:36.320542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59450-fe86-40df-be2d-d86b1f75d30c None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:36.321142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59450-fe86-40df-be2d-d86b1f75d30c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:36.321142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59450-fe86-40df-be2d-d86b1f75d30c None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:36.322779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 701/1389] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:36.330072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488780ec-5739-4a9f-ac94-988c514c18e5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:36.330540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488780ec-5739-4a9f-ac94-988c514c18e5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:36.330893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488780ec-5739-4a9f-ac94-988c514c18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:36.355511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-488780ec-5739-4a9f-ac94-988c514c18e5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:36.357236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-488780ec-5739-4a9f-ac94-988c514c18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:36.368549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 689/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:36.422098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59450-fe86-40df-be2d-d86b1f75d30c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:36.440878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59450-fe86-40df-be2d-d86b1f75d30c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:36.447469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe039-8955-4093-b444-2a2c67b4aa12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:36.448189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe039-8955-4093-b444-2a2c67b4aa12 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:36.448491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe039-8955-4093-b444-2a2c67b4aa12 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:36.448786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe039-8955-4093-b444-2a2c67b4aa12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:36.458529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fe039-8955-4093-b444-2a2c67b4aa12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:36.460384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fe039-8955-4093-b444-2a2c67b4aa12 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:36.471212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 702/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:38.786468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b100-e2e4-43a5-b9b5-6356e6a678bb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:38.787058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b100-e2e4-43a5-b9b5-6356e6a678bb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:38.787058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b100-e2e4-43a5-b9b5-6356e6a678bb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:38.788507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 690/1392] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:38.793646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a835-698b-41ef-bf05-bd7a552c8c8b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:38.794103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a835-698b-41ef-bf05-bd7a552c8c8b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:38.794210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a835-698b-41ef-bf05-bd7a552c8c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:38.812192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9a05a835-698b-41ef-bf05-bd7a552c8c8b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:38.813430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9a05a835-698b-41ef-bf05-bd7a552c8c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:38.821424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 703/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:38.865257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0b100-e2e4-43a5-b9b5-6356e6a678bb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:38.879659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0b100-e2e4-43a5-b9b5-6356e6a678bb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:38.885357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03a534-77ba-4482-883b-371dce1cb7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:38.886015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a534-77ba-4482-883b-371dce1cb7f0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:38.886345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a534-77ba-4482-883b-371dce1cb7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:38.886598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a534-77ba-4482-883b-371dce1cb7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:38.895649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03a534-77ba-4482-883b-371dce1cb7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:38.897250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03a534-77ba-4482-883b-371dce1cb7f0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:38.907159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 691/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:04:40.401836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b722296-08d2-490f-acc1-5d918e5eb093 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:40.402310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b722296-08d2-490f-acc1-5d918e5eb093 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:40.402422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b722296-08d2-490f-acc1-5d918e5eb093 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:40.403762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 704/1395] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:40.409376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924f90e-02d6-40aa-88a4-00d0812ba9aa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:40.409830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924f90e-02d6-40aa-88a4-00d0812ba9aa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:40.409958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924f90e-02d6-40aa-88a4-00d0812ba9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:40.416266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=52 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:40.429093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f924f90e-02d6-40aa-88a4-00d0812ba9aa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:40.430298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f924f90e-02d6-40aa-88a4-00d0812ba9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:40.438610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 692/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:40.492668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3572f-0ab8-4e3b-92ef-0512ad3c6aff None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:40.492957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3572f-0ab8-4e3b-92ef-0512ad3c6aff None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:40.493268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3572f-0ab8-4e3b-92ef-0512ad3c6aff None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:40.494635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 705/1397] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jun 7 13:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:40.499703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461ad6e-b956-4963-86d3-29d041fdcdd8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:40.499986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461ad6e-b956-4963-86d3-29d041fdcdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:40.500260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461ad6e-b956-4963-86d3-29d041fdcdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:40.549565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9461ad6e-b956-4963-86d3-29d041fdcdd8 None None] MFA Rules not processed for user `643c0511de594207bf8fbdd5b295267f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:40.550747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9461ad6e-b956-4963-86d3-29d041fdcdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:40.614323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 693/1398] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jun 7 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:40.622123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3572f-0ab8-4e3b-92ef-0512ad3c6aff None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:40.633419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3572f-0ab8-4e3b-92ef-0512ad3c6aff None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:40.637124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21812ea5-c5b5-4548-8480-7ebc117282ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:40.637852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21812ea5-c5b5-4548-8480-7ebc117282ea service glance] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:40.638200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21812ea5-c5b5-4548-8480-7ebc117282ea service glance] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:40.638473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21812ea5-c5b5-4548-8480-7ebc117282ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:40.648291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21812ea5-c5b5-4548-8480-7ebc117282ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:40.649695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21812ea5-c5b5-4548-8480-7ebc117282ea service glance] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:40.659202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 706/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:04:41.185632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8933d9-fc08-437c-abf3-429e0acb2457 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.185946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8933d9-fc08-437c-abf3-429e0acb2457 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.186271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8933d9-fc08-437c-abf3-429e0acb2457 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.187663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 694/1400] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:41.188075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a48619-759d-4f2a-b1c3-203e642094e4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.188458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a48619-759d-4f2a-b1c3-203e642094e4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.188841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a48619-759d-4f2a-b1c3-203e642094e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.192649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.192940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.193241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.211184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:41.212379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:41.220235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 695/1401] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:41.240271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-16a48619-759d-4f2a-b1c3-203e642094e4 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:41.241512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-16a48619-759d-4f2a-b1c3-203e642094e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:41.265814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:41.278200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea5dd3-714e-4d00-948d-35d666995317 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:41.284376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a4219-447e-4042-a52e-61dd5bad6bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:41.285051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a4219-447e-4042-a52e-61dd5bad6bd1 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.285329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a4219-447e-4042-a52e-61dd5bad6bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.285597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a4219-447e-4042-a52e-61dd5bad6bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.293758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a4219-447e-4042-a52e-61dd5bad6bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:41.295472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a4219-447e-4042-a52e-61dd5bad6bd1 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:41.305125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 696/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:04:41.310357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 707/1403] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:41.357750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa05c2-d5d9-4749-822d-03958807d8d7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.358429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa05c2-d5d9-4749-822d-03958807d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.359001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa05c2-d5d9-4749-822d-03958807d8d7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.360784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 697/1404] 10.222.0.20 () {54 vars in 942 bytes} [Tue Jun 7 13:04:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:41.367823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae01df-313c-4bce-bdc1-c3e0a26d57eb None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.368146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae01df-313c-4bce-bdc1-c3e0a26d57eb None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.368476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae01df-313c-4bce-bdc1-c3e0a26d57eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.432299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-46ae01df-313c-4bce-bdc1-c3e0a26d57eb None None] MFA Rules not processed for user `c3a96be7cce14b2e964bb6f3ff2d9b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:41.433503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-46ae01df-313c-4bce-bdc1-c3e0a26d57eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:41.480974 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:41.516648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 708/1405] 10.222.0.20 () {58 vars in 1039 bytes} [Tue Jun 7 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:04:41.526410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa05c2-d5d9-4749-822d-03958807d8d7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:41.541293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa05c2-d5d9-4749-822d-03958807d8d7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:41.547044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d0d7-b82b-44c1-841b-456e601a0aa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:41.547717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d0d7-b82b-44c1-841b-456e601a0aa0 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:41.547998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d0d7-b82b-44c1-841b-456e601a0aa0 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:41.548275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d0d7-b82b-44c1-841b-456e601a0aa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:41.557622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d0d7-b82b-44c1-841b-456e601a0aa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:41.559232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d0d7-b82b-44c1-841b-456e601a0aa0 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:41.568568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 698/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:04:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:04:43.658320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce914bdb-f366-4d48-bc52-df2d5a8c32d7 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:43.658872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce914bdb-f366-4d48-bc52-df2d5a8c32d7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:43.658872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce914bdb-f366-4d48-bc52-df2d5a8c32d7 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:43.660243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 709/1407] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:04:43.667172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348ab5-a6ea-4ecf-9510-214e85b78dc0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:43.667675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348ab5-a6ea-4ecf-9510-214e85b78dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:43.667855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348ab5-a6ea-4ecf-9510-214e85b78dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:43.687583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-77348ab5-a6ea-4ecf-9510-214e85b78dc0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:04:43.688918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-77348ab5-a6ea-4ecf-9510-214e85b78dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:04:43.697075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 699/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:04:43.741992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce914bdb-f366-4d48-bc52-df2d5a8c32d7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:04:43.756720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce914bdb-f366-4d48-bc52-df2d5a8c32d7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:04:43.762136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e86f-0201-4683-a5e6-e89a3855aa57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:04:43.762787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e86f-0201-4683-a5e6-e89a3855aa57 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:04:43.763069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e86f-0201-4683-a5e6-e89a3855aa57 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:04:43.763351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e86f-0201-4683-a5e6-e89a3855aa57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:04:43.774028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528e86f-0201-4683-a5e6-e89a3855aa57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:04:43.775663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528e86f-0201-4683-a5e6-e89a3855aa57 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:04:43.786480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 710/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:04:53.764159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=58 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:53.787731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=18 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:05:04.986061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad79060-614a-423b-b3db-3f8996697a48 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:04.986723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad79060-614a-423b-b3db-3f8996697a48 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:04.986723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad79060-614a-423b-b3db-3f8996697a48 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:04.987975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 700/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jun 7 13:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:04.993952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b5d5-450e-4c88-97d7-7a44d5985ca6 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:04.994371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b5d5-450e-4c88-97d7-7a44d5985ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:04.994549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b5d5-450e-4c88-97d7-7a44d5985ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:05.021153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8003b5d5-450e-4c88-97d7-7a44d5985ca6 None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:05.022371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8003b5d5-450e-4c88-97d7-7a44d5985ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:05.032835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 711/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jun 7 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:05.047636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbb4a4-b55f-4fc2-b20f-9708fb2dfb8b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:05.047895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbb4a4-b55f-4fc2-b20f-9708fb2dfb8b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:05.048169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbb4a4-b55f-4fc2-b20f-9708fb2dfb8b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:05.049585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 701/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jun 7 13:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:05.054381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f095e-247e-4252-9af8-2569befd8618 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:05.054679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f095e-247e-4252-9af8-2569befd8618 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:05.054959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f095e-247e-4252-9af8-2569befd8618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:05.074280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-bf5f095e-247e-4252-9af8-2569befd8618 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:05.075685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bf5f095e-247e-4252-9af8-2569befd8618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:05.085637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 712/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jun 7 13:05:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:07.890627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421fd75-e23e-4a5a-804e-8836a8abd048 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:07.891183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421fd75-e23e-4a5a-804e-8836a8abd048 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:07.891183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421fd75-e23e-4a5a-804e-8836a8abd048 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:07.892493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:07.898883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fee10-f48d-4d82-887d-dce23a0559f6 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:07.899358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fee10-f48d-4d82-887d-dce23a0559f6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:07.899657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fee10-f48d-4d82-887d-dce23a0559f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:07.920198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0c3fee10-f48d-4d82-887d-dce23a0559f6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:07.921432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0c3fee10-f48d-4d82-887d-dce23a0559f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:07.930061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:07.982637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421fd75-e23e-4a5a-804e-8836a8abd048 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:07.999642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421fd75-e23e-4a5a-804e-8836a8abd048 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:08.005889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638474-1e60-48c9-b6a8-94a8a0e65c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:08.006534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638474-1e60-48c9-b6a8-94a8a0e65c6e service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:08.006813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638474-1e60-48c9-b6a8-94a8a0e65c6e service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:08.007084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638474-1e60-48c9-b6a8-94a8a0e65c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:08.015946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638474-1e60-48c9-b6a8-94a8a0e65c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:08.017565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638474-1e60-48c9-b6a8-94a8a0e65c6e service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:08.026914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 703/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:09.003751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c55a35-7b3c-497f-8fed-3e276c6707e7 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:09.004305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c55a35-7b3c-497f-8fed-3e276c6707e7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:09.004305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c55a35-7b3c-497f-8fed-3e276c6707e7 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:09.005882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:09.010895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eec95-676c-42d5-9b9c-1639bd9f420f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:09.011356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eec95-676c-42d5-9b9c-1639bd9f420f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:09.011464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eec95-676c-42d5-9b9c-1639bd9f420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:09.030837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9b4eec95-676c-42d5-9b9c-1639bd9f420f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:09.032016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9b4eec95-676c-42d5-9b9c-1639bd9f420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:09.044963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:09.204843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c55a35-7b3c-497f-8fed-3e276c6707e7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:09.224262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c55a35-7b3c-497f-8fed-3e276c6707e7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:09.230524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d4ec8-416e-48dd-a1d6-a8cc29b080ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:09.231164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d4ec8-416e-48dd-a1d6-a8cc29b080ea service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:09.231441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d4ec8-416e-48dd-a1d6-a8cc29b080ea service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:09.231707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d4ec8-416e-48dd-a1d6-a8cc29b080ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:09.240289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d4ec8-416e-48dd-a1d6-a8cc29b080ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:09.241908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d4ec8-416e-48dd-a1d6-a8cc29b080ea service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:09.251978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 715/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:10.183166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b8728-b081-4a5a-ade5-98931ec070c9 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:10.183745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b8728-b081-4a5a-ade5-98931ec070c9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:10.183745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b8728-b081-4a5a-ade5-98931ec070c9 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:10.185479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:10.191554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098e2e-ab50-4aae-9f37-ad1130b76121 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:10.192284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098e2e-ab50-4aae-9f37-ad1130b76121 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:10.192548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098e2e-ab50-4aae-9f37-ad1130b76121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:10.220680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-28098e2e-ab50-4aae-9f37-ad1130b76121 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:10.221930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-28098e2e-ab50-4aae-9f37-ad1130b76121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:10.231342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:10.386607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b8728-b081-4a5a-ade5-98931ec070c9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:10.405450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b8728-b081-4a5a-ade5-98931ec070c9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:10.411593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116485-db78-4b4d-b343-f5920cd08013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:10.412247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116485-db78-4b4d-b343-f5920cd08013 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:10.412502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116485-db78-4b4d-b343-f5920cd08013 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:10.412770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116485-db78-4b4d-b343-f5920cd08013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:10.422050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc116485-db78-4b4d-b343-f5920cd08013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:10.423643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc116485-db78-4b4d-b343-f5920cd08013 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:10.433161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 706/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:11.331792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db8bf-70f5-4e71-bf7a-49a034ab7acb None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:11.332586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db8bf-70f5-4e71-bf7a-49a034ab7acb None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:11.332586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db8bf-70f5-4e71-bf7a-49a034ab7acb None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:11.334935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:11.341365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a783fb-25f4-4f76-a51b-3ecd3a4157cd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:11.341912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a783fb-25f4-4f76-a51b-3ecd3a4157cd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:11.341912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a783fb-25f4-4f76-a51b-3ecd3a4157cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:11.362335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-35a783fb-25f4-4f76-a51b-3ecd3a4157cd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:11.363554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-35a783fb-25f4-4f76-a51b-3ecd3a4157cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:11.373100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:11.529424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db8bf-70f5-4e71-bf7a-49a034ab7acb None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:11.554220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db8bf-70f5-4e71-bf7a-49a034ab7acb None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:11.564322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccca77f-f2f9-41f7-9849-7d4689d57509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:11.565302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccca77f-f2f9-41f7-9849-7d4689d57509 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:11.565808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccca77f-f2f9-41f7-9849-7d4689d57509 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:11.566148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccca77f-f2f9-41f7-9849-7d4689d57509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:11.578849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccca77f-f2f9-41f7-9849-7d4689d57509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:11.580461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccca77f-f2f9-41f7-9849-7d4689d57509 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:11.591183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 718/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:12.515943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f07c3f-2244-4100-beda-3f25aae6e4c2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:12.516503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f07c3f-2244-4100-beda-3f25aae6e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:12.516503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f07c3f-2244-4100-beda-3f25aae6e4c2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:12.517935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:12.524008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd714c2-d0d1-44a1-83f4-f781fd7f4efd None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:12.524511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd714c2-d0d1-44a1-83f4-f781fd7f4efd None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:12.524511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd714c2-d0d1-44a1-83f4-f781fd7f4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:12.556326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-cdd714c2-d0d1-44a1-83f4-f781fd7f4efd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:12.558170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cdd714c2-d0d1-44a1-83f4-f781fd7f4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:12.572675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:12.725711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f07c3f-2244-4100-beda-3f25aae6e4c2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:12.744145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f07c3f-2244-4100-beda-3f25aae6e4c2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:12.750216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6080ba1-55d1-4951-b3c5-5b7690934c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:12.750859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6080ba1-55d1-4951-b3c5-5b7690934c33 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:12.751142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6080ba1-55d1-4951-b3c5-5b7690934c33 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:12.751422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6080ba1-55d1-4951-b3c5-5b7690934c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:12.759967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6080ba1-55d1-4951-b3c5-5b7690934c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:12.761592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6080ba1-55d1-4951-b3c5-5b7690934c33 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:12.771932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 709/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:13.613444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6610-ec16-461b-aba6-f79e2e138243 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:13.613939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6610-ec16-461b-aba6-f79e2e138243 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:13.614036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6610-ec16-461b-aba6-f79e2e138243 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:13.616148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:13.623357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5f528-89d3-4cff-b6ba-81386e52438a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:13.623799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5f528-89d3-4cff-b6ba-81386e52438a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:13.623914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5f528-89d3-4cff-b6ba-81386e52438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:13.643642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4ef5f528-89d3-4cff-b6ba-81386e52438a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:13.644849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4ef5f528-89d3-4cff-b6ba-81386e52438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:13.654275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:13.806813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d6610-ec16-461b-aba6-f79e2e138243 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:13.823878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d6610-ec16-461b-aba6-f79e2e138243 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:13.829967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7faa5-540b-4461-84a5-c7b4141a5e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:13.830604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7faa5-540b-4461-84a5-c7b4141a5e66 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:13.830880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7faa5-540b-4461-84a5-c7b4141a5e66 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:13.831149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7faa5-540b-4461-84a5-c7b4141a5e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:13.839242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7faa5-540b-4461-84a5-c7b4141a5e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:13.841078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7faa5-540b-4461-84a5-c7b4141a5e66 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:13.850850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 721/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:14.753918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f1c2-9deb-4deb-aeca-f81fa0532727 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:14.754474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f1c2-9deb-4deb-aeca-f81fa0532727 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:14.754474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f1c2-9deb-4deb-aeca-f81fa0532727 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:14.755766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:14.762024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d1d3-ace3-441e-b4c8-d1adb13dd561 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:14.762729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d1d3-ace3-441e-b4c8-d1adb13dd561 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:14.762826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d1d3-ace3-441e-b4c8-d1adb13dd561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:14.791942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ae09d1d3-ace3-441e-b4c8-d1adb13dd561 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:14.794014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ae09d1d3-ace3-441e-b4c8-d1adb13dd561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:14.804067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:14.957503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f1c2-9deb-4deb-aeca-f81fa0532727 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:14.980353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f1c2-9deb-4deb-aeca-f81fa0532727 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:14.988461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f819f-d051-4764-bc2d-09e3c2a08d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:14.989148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f819f-d051-4764-bc2d-09e3c2a08d61 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:14.989430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f819f-d051-4764-bc2d-09e3c2a08d61 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:14.989701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f819f-d051-4764-bc2d-09e3c2a08d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:14.998749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f819f-d051-4764-bc2d-09e3c2a08d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:15.000349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f819f-d051-4764-bc2d-09e3c2a08d61 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:15.010498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 712/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:15.863308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6065702-d5b8-4fd3-8874-e22f703a81c9 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:15.863860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6065702-d5b8-4fd3-8874-e22f703a81c9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:15.863860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6065702-d5b8-4fd3-8874-e22f703a81c9 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:15.865206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:15.870253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9981-2a90-4c80-831e-ad7452d5d6a2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:15.870702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9981-2a90-4c80-831e-ad7452d5d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:15.870828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9981-2a90-4c80-831e-ad7452d5d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:15.895190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-76ba9981-2a90-4c80-831e-ad7452d5d6a2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:15.897132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-76ba9981-2a90-4c80-831e-ad7452d5d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:15.907901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:05:16.063124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6065702-d5b8-4fd3-8874-e22f703a81c9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:16.088820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6065702-d5b8-4fd3-8874-e22f703a81c9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:16.096307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf7a7f-dad8-4990-b60a-cfde0bf0b69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:16.096959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf7a7f-dad8-4990-b60a-cfde0bf0b69f service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:16.097262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf7a7f-dad8-4990-b60a-cfde0bf0b69f service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:16.097541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf7a7f-dad8-4990-b60a-cfde0bf0b69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:16.106202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf7a7f-dad8-4990-b60a-cfde0bf0b69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:16.107884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf7a7f-dad8-4990-b60a-cfde0bf0b69f service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:16.117480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 724/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:16.995704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797699c-b58d-47d4-8118-beb89053ff61 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:16.996441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797699c-b58d-47d4-8118-beb89053ff61 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:16.996441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797699c-b58d-47d4-8118-beb89053ff61 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:16.998332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:05:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:17.003426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17634f-863f-4084-a69c-c103705a0436 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:17.003870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17634f-863f-4084-a69c-c103705a0436 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:17.003976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17634f-863f-4084-a69c-c103705a0436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:17.029345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2a17634f-863f-4084-a69c-c103705a0436 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:17.031096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2a17634f-863f-4084-a69c-c103705a0436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:17.044730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:17.196496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797699c-b58d-47d4-8118-beb89053ff61 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:17.214047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797699c-b58d-47d4-8118-beb89053ff61 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:17.220496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf942a4-3ea8-4bed-94bb-8118348b6266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:17.221183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf942a4-3ea8-4bed-94bb-8118348b6266 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:17.221470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf942a4-3ea8-4bed-94bb-8118348b6266 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:17.221747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf942a4-3ea8-4bed-94bb-8118348b6266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:17.230372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf942a4-3ea8-4bed-94bb-8118348b6266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:17.232504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf942a4-3ea8-4bed-94bb-8118348b6266 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:17.242786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 715/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:19.358599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6c68-5b36-45e8-84d1-ce8ead35d931 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:19.359202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6c68-5b36-45e8-84d1-ce8ead35d931 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:19.359202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6c68-5b36-45e8-84d1-ce8ead35d931 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:19.360541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:19.367304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cc09a-74e7-4f55-86f9-584fed7a1cf1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:19.368033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cc09a-74e7-4f55-86f9-584fed7a1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:19.368156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cc09a-74e7-4f55-86f9-584fed7a1cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:19.395179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fb1cc09a-74e7-4f55-86f9-584fed7a1cf1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:19.396384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fb1cc09a-74e7-4f55-86f9-584fed7a1cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:19.405914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:19.445199 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6c68-5b36-45e8-84d1-ce8ead35d931 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:19.456963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6c68-5b36-45e8-84d1-ce8ead35d931 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:19.463784 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8cfd1-78c1-4f23-aa0b-c0981f1ca8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:19.464649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8cfd1-78c1-4f23-aa0b-c0981f1ca8ea service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:19.464984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8cfd1-78c1-4f23-aa0b-c0981f1ca8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:19.465445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8cfd1-78c1-4f23-aa0b-c0981f1ca8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:19.480016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8cfd1-78c1-4f23-aa0b-c0981f1ca8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:19.482138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8cfd1-78c1-4f23-aa0b-c0981f1ca8ea service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:19.492107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 727/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:22.017251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69814ad-5bfa-441c-ab8d-c8991fb7ee55 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:22.018082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69814ad-5bfa-441c-ab8d-c8991fb7ee55 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:22.018082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69814ad-5bfa-441c-ab8d-c8991fb7ee55 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:22.020232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:22.028691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e079-e890-4ea3-8546-837937fa43b1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:22.029162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e079-e890-4ea3-8546-837937fa43b1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:22.029266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e079-e890-4ea3-8546-837937fa43b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:22.047970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6a15e079-e890-4ea3-8546-837937fa43b1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:22.049201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6a15e079-e890-4ea3-8546-837937fa43b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:22.058007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:22.107760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69814ad-5bfa-441c-ab8d-c8991fb7ee55 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:22.121683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69814ad-5bfa-441c-ab8d-c8991fb7ee55 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:22.126218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beed50-3d87-4382-8cce-9606f77cb237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:22.126865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beed50-3d87-4382-8cce-9606f77cb237 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:22.127156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beed50-3d87-4382-8cce-9606f77cb237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:22.127488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beed50-3d87-4382-8cce-9606f77cb237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:22.137371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beed50-3d87-4382-8cce-9606f77cb237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:22.138835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beed50-3d87-4382-8cce-9606f77cb237 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:22.148811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 718/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:24.786024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358ffc-e749-43a5-919f-b12a5548109a None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:24.786942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358ffc-e749-43a5-919f-b12a5548109a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:24.786942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358ffc-e749-43a5-919f-b12a5548109a None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:24.788961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:24.796105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c149-28d9-4662-b75e-8e5f264cbbf4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:24.796570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c149-28d9-4662-b75e-8e5f264cbbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:24.796676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c149-28d9-4662-b75e-8e5f264cbbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:24.817582 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5600c149-28d9-4662-b75e-8e5f264cbbf4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:24.818808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5600c149-28d9-4662-b75e-8e5f264cbbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:24.827393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:24.869527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e358ffc-e749-43a5-919f-b12a5548109a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:24.883731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e358ffc-e749-43a5-919f-b12a5548109a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:24.888170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a18bfb-7880-457a-b2d4-850616e213f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:24.888811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18bfb-7880-457a-b2d4-850616e213f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:24.889546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18bfb-7880-457a-b2d4-850616e213f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:24.889823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18bfb-7880-457a-b2d4-850616e213f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:24.900350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18bfb-7880-457a-b2d4-850616e213f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:24.901828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18bfb-7880-457a-b2d4-850616e213f4 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:24.912425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 730/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:27.249295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c3e6-daf7-4209-87b6-02ef88b5ce91 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:27.249846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c3e6-daf7-4209-87b6-02ef88b5ce91 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:27.249846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c3e6-daf7-4209-87b6-02ef88b5ce91 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:27.251304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:27.256781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849167b-ab31-465d-80cf-52d86281e293 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:27.257245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849167b-ab31-465d-80cf-52d86281e293 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:27.257431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849167b-ab31-465d-80cf-52d86281e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:27.275747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7849167b-ab31-465d-80cf-52d86281e293 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:27.276969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7849167b-ab31-465d-80cf-52d86281e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:27.285343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:27.325438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c3e6-daf7-4209-87b6-02ef88b5ce91 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:27.342576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c3e6-daf7-4209-87b6-02ef88b5ce91 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:27.346901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa9de-a3a2-4289-abe0-fade6b95199a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:27.347542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa9de-a3a2-4289-abe0-fade6b95199a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:27.347825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa9de-a3a2-4289-abe0-fade6b95199a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:27.348098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa9de-a3a2-4289-abe0-fade6b95199a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:27.357652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa9de-a3a2-4289-abe0-fade6b95199a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:27.359095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa9de-a3a2-4289-abe0-fade6b95199a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:27.368316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 721/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:29.728193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c82d6-cdda-40a2-a937-0ff5b0e5ebfb None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:29.728938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c82d6-cdda-40a2-a937-0ff5b0e5ebfb None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:29.728938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c82d6-cdda-40a2-a937-0ff5b0e5ebfb None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:29.730155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:29.736666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bceba3-b3ac-404c-8f31-48ea23a739dc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:29.737364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bceba3-b3ac-404c-8f31-48ea23a739dc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:29.737484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bceba3-b3ac-404c-8f31-48ea23a739dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:29.765672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c4bceba3-b3ac-404c-8f31-48ea23a739dc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:29.766905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c4bceba3-b3ac-404c-8f31-48ea23a739dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:29.776390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:29.814675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c82d6-cdda-40a2-a937-0ff5b0e5ebfb None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:29.826263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c82d6-cdda-40a2-a937-0ff5b0e5ebfb None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:29.830166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17a094-bde1-4020-854b-337da4a9d0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:29.830802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a094-bde1-4020-854b-337da4a9d0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:29.831076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a094-bde1-4020-854b-337da4a9d0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:29.831349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a094-bde1-4020-854b-337da4a9d0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:29.841319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17a094-bde1-4020-854b-337da4a9d0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:29.842750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17a094-bde1-4020-854b-337da4a9d0b2 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:29.852772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 733/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:05:32.216909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e752e1a-2ea5-4701-990b-8994028b1ac5 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:32.217535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e752e1a-2ea5-4701-990b-8994028b1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:32.217535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e752e1a-2ea5-4701-990b-8994028b1ac5 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:32.218863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:32.228175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69251-f27e-4eb6-8be2-d5e9a928b693 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:32.228925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69251-f27e-4eb6-8be2-d5e9a928b693 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:32.229107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69251-f27e-4eb6-8be2-d5e9a928b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:32.255917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e8d69251-f27e-4eb6-8be2-d5e9a928b693 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:32.257497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e8d69251-f27e-4eb6-8be2-d5e9a928b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:32.268508 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:32.310782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e752e1a-2ea5-4701-990b-8994028b1ac5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:32.328250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e752e1a-2ea5-4701-990b-8994028b1ac5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:32.332580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a91f2-bac0-4c5f-948d-25be19bb157c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:32.333261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a91f2-bac0-4c5f-948d-25be19bb157c service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:32.333543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a91f2-bac0-4c5f-948d-25be19bb157c service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:32.333816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a91f2-bac0-4c5f-948d-25be19bb157c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:32.343231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a91f2-bac0-4c5f-948d-25be19bb157c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:32.344697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a91f2-bac0-4c5f-948d-25be19bb157c service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:32.354830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 724/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:34.626782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466de48c-5c39-4ff2-8d4e-7d00b44d83a6 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:34.627306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466de48c-5c39-4ff2-8d4e-7d00b44d83a6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:34.627408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466de48c-5c39-4ff2-8d4e-7d00b44d83a6 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:34.629466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:34.635019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8844ed-5a36-4b62-9df4-5e23dbb6b9c0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:34.635466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8844ed-5a36-4b62-9df4-5e23dbb6b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:34.635570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8844ed-5a36-4b62-9df4-5e23dbb6b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:34.642782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=70 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:05:34.657387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-da8844ed-5a36-4b62-9df4-5e23dbb6b9c0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:34.658592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-da8844ed-5a36-4b62-9df4-5e23dbb6b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:34.666855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:34.707553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466de48c-5c39-4ff2-8d4e-7d00b44d83a6 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:34.716425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=73 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:05:34.723301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466de48c-5c39-4ff2-8d4e-7d00b44d83a6 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:34.727068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4091aff-40ca-45d5-bb15-9c055527fafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:34.727702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4091aff-40ca-45d5-bb15-9c055527fafd service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:34.727982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4091aff-40ca-45d5-bb15-9c055527fafd service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:34.728253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4091aff-40ca-45d5-bb15-9c055527fafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:34.738500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4091aff-40ca-45d5-bb15-9c055527fafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:34.739933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4091aff-40ca-45d5-bb15-9c055527fafd service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:34.750061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 736/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:37.134854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194611-16f6-4305-b990-3c7f6f34da68 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:37.135769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194611-16f6-4305-b990-3c7f6f34da68 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:37.135769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194611-16f6-4305-b990-3c7f6f34da68 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:37.137949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:37.144840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a04d3-a173-49a7-b37e-74910fdfdc39 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:37.145579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a04d3-a173-49a7-b37e-74910fdfdc39 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:37.145921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a04d3-a173-49a7-b37e-74910fdfdc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:37.167005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ed3a04d3-a173-49a7-b37e-74910fdfdc39 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:37.168357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ed3a04d3-a173-49a7-b37e-74910fdfdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:37.176499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:37.217883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3194611-16f6-4305-b990-3c7f6f34da68 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:37.231509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3194611-16f6-4305-b990-3c7f6f34da68 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:37.235797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a336a-03da-44ba-9bf9-cd26dc9ab904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:37.236460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a336a-03da-44ba-9bf9-cd26dc9ab904 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:37.236707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a336a-03da-44ba-9bf9-cd26dc9ab904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:37.236998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a336a-03da-44ba-9bf9-cd26dc9ab904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:37.247552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a336a-03da-44ba-9bf9-cd26dc9ab904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:37.249445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a336a-03da-44ba-9bf9-cd26dc9ab904 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:37.263373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 727/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:39.543926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e08602-9fa8-414f-bbc3-737606f53f79 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:39.544568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e08602-9fa8-414f-bbc3-737606f53f79 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:39.544568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e08602-9fa8-414f-bbc3-737606f53f79 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:39.545892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:39.552365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2a1c2-b206-4101-8b8b-0fd73dc1be36 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:39.552817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2a1c2-b206-4101-8b8b-0fd73dc1be36 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:39.552919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2a1c2-b206-4101-8b8b-0fd73dc1be36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:39.579249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5ce2a1c2-b206-4101-8b8b-0fd73dc1be36 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:39.580476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ce2a1c2-b206-4101-8b8b-0fd73dc1be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:39.589934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:39.626181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e08602-9fa8-414f-bbc3-737606f53f79 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:39.638928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e08602-9fa8-414f-bbc3-737606f53f79 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:39.643068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78a83-5d57-419c-9ada-33c60272fd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:39.643714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78a83-5d57-419c-9ada-33c60272fd32 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:39.643994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78a83-5d57-419c-9ada-33c60272fd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:39.644267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78a83-5d57-419c-9ada-33c60272fd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:39.654091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78a83-5d57-419c-9ada-33c60272fd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:39.655524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78a83-5d57-419c-9ada-33c60272fd32 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:39.664945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 739/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:41.876459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc9c1-bdc4-49b2-9faa-a29356aceeda None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:41.877052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc9c1-bdc4-49b2-9faa-a29356aceeda None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:41.877052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc9c1-bdc4-49b2-9faa-a29356aceeda None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:41.878325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:05:41.884890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5b40d-406f-40b1-b01a-b6d8006ea5ba None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:41.885664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5b40d-406f-40b1-b01a-b6d8006ea5ba None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:41.885843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5b40d-406f-40b1-b01a-b6d8006ea5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:41.906694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-eae5b40d-406f-40b1-b01a-b6d8006ea5ba None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:05:41.907977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-eae5b40d-406f-40b1-b01a-b6d8006ea5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:05:41.917751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:05:41.968198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdc9c1-bdc4-49b2-9faa-a29356aceeda None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:05:41.983773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdc9c1-bdc4-49b2-9faa-a29356aceeda None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:05:41.987206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c52128-df87-49bb-9bcf-2e56a3a4071b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:05:41.987848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52128-df87-49bb-9bcf-2e56a3a4071b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:05:41.988136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52128-df87-49bb-9bcf-2e56a3a4071b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:05:41.988410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52128-df87-49bb-9bcf-2e56a3a4071b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:05:41.998011 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c52128-df87-49bb-9bcf-2e56a3a4071b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:05:41.999453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c52128-df87-49bb-9bcf-2e56a3a4071b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:05:42.008902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 730/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:51.900443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=17 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:05:52.004746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=17 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:13.610797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeafa5a-5f9d-41ec-ba75-e20e34912c41 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:13.610797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeafa5a-5f9d-41ec-ba75-e20e34912c41 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:13.611295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeafa5a-5f9d-41ec-ba75-e20e34912c41 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:13.612329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 741/1471] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:13.617855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a849e52-93ef-456f-8d53-8ec8b4a28711 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:13.618318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a849e52-93ef-456f-8d53-8ec8b4a28711 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:13.618415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a849e52-93ef-456f-8d53-8ec8b4a28711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:13.638435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5a849e52-93ef-456f-8d53-8ec8b4a28711 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:13.639680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5a849e52-93ef-456f-8d53-8ec8b4a28711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:13.649829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 731/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:13.700176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66c4f4-dc81-4140-97f8-2159204bfd15 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:13.700461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66c4f4-dc81-4140-97f8-2159204bfd15 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:13.700756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66c4f4-dc81-4140-97f8-2159204bfd15 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:13.702183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 742/1473] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jun 7 13:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:13.710033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4a65-b025-424b-be26-57c6968c5adf None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:13.710486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4a65-b025-424b-be26-57c6968c5adf None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:13.710920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4a65-b025-424b-be26-57c6968c5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:13.731196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a35b4a65-b025-424b-be26-57c6968c5adf None None] MFA Rules not processed for user `643c0511de594207bf8fbdd5b295267f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:13.732398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a35b4a65-b025-424b-be26-57c6968c5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:13.740167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 732/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jun 7 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:13.747705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66c4f4-dc81-4140-97f8-2159204bfd15 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:13.760603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66c4f4-dc81-4140-97f8-2159204bfd15 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:13.765409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2c614-9be1-42a0-be95-de7ad6aa1bd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:13.766037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c614-9be1-42a0-be95-de7ad6aa1bd5 service glance] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:13.766318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c614-9be1-42a0-be95-de7ad6aa1bd5 service glance] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:13.766574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c614-9be1-42a0-be95-de7ad6aa1bd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:13.776635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2c614-9be1-42a0-be95-de7ad6aa1bd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:13.778090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2c614-9be1-42a0-be95-de7ad6aa1bd5 service glance] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:13.787458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 743/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:06:16.101116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749cf3-ca55-465b-837b-dcc0c83eca01 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:16.101719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749cf3-ca55-465b-837b-dcc0c83eca01 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:16.101719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749cf3-ca55-465b-837b-dcc0c83eca01 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:16.103059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 733/1476] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 13:06:16.108680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76006d-17d4-4172-aaab-e7aeabeffa75 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:16.109149 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76006d-17d4-4172-aaab-e7aeabeffa75 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:16.109251 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76006d-17d4-4172-aaab-e7aeabeffa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:16.128384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0b76006d-17d4-4172-aaab-e7aeabeffa75 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:16.129648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0b76006d-17d4-4172-aaab-e7aeabeffa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:16.138332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 744/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:16.161580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749cf3-ca55-465b-837b-dcc0c83eca01 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:16.177827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749cf3-ca55-465b-837b-dcc0c83eca01 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:16.183672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:16.184327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:16.184610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:16.184881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:16.185655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:16.187440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:06:16.187440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:06:16.187440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:06:16.188577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4b7c4-581c-4547-8fec-feba82762aef admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:16.208245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 734/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jun 7 13:06:16 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:06:18.535254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bb32d-a138-4140-8ee9-7e344d64f313 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:18.535820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bb32d-a138-4140-8ee9-7e344d64f313 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:18.535917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bb32d-a138-4140-8ee9-7e344d64f313 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:18.537544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 745/1479] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:18.545194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a40a6-b40d-4844-b74e-e94e1a10f29b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:18.545659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a40a6-b40d-4844-b74e-e94e1a10f29b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:18.545795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a40a6-b40d-4844-b74e-e94e1a10f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:18.567237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7f7a40a6-b40d-4844-b74e-e94e1a10f29b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:18.568483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7f7a40a6-b40d-4844-b74e-e94e1a10f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:18.579574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 735/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:18.626038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bb32d-a138-4140-8ee9-7e344d64f313 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:18.642578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bb32d-a138-4140-8ee9-7e344d64f313 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:18.648595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716f679-535b-4658-b9b0-51a370033ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:18.649279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f679-535b-4658-b9b0-51a370033ad9 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:18.649572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f679-535b-4658-b9b0-51a370033ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:18.649839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f679-535b-4658-b9b0-51a370033ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:18.658725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716f679-535b-4658-b9b0-51a370033ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:18.660363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716f679-535b-4658-b9b0-51a370033ad9 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:18.670463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 746/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:06:21.145875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758146a-838c-45ba-92e5-426e0947a7fa None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:21.146771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758146a-838c-45ba-92e5-426e0947a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:21.146771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758146a-838c-45ba-92e5-426e0947a7fa None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:21.148959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 736/1482] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:21.155630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95ac21-4c82-46b3-8b77-d6312fdf65e4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:21.156087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95ac21-4c82-46b3-8b77-d6312fdf65e4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:21.156195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95ac21-4c82-46b3-8b77-d6312fdf65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:21.176374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1d95ac21-4c82-46b3-8b77-d6312fdf65e4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:21.177620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1d95ac21-4c82-46b3-8b77-d6312fdf65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:21.187262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 747/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:21.223790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758146a-838c-45ba-92e5-426e0947a7fa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:21.235418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758146a-838c-45ba-92e5-426e0947a7fa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:21.239140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95c9a-dbc9-43c0-8c64-8835e5b39f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:21.239784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95c9a-dbc9-43c0-8c64-8835e5b39f82 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:21.240078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95c9a-dbc9-43c0-8c64-8835e5b39f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:21.240349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95c9a-dbc9-43c0-8c64-8835e5b39f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:21.250120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c95c9a-dbc9-43c0-8c64-8835e5b39f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:21.251603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c95c9a-dbc9-43c0-8c64-8835e5b39f82 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:21.265223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 737/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:06:23.568490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b853d-ebad-4a0b-9d08-70a192029b46 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:23.569462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b853d-ebad-4a0b-9d08-70a192029b46 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:23.569462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b853d-ebad-4a0b-9d08-70a192029b46 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:23.571669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 748/1485] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:23.578148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71c78-287a-454f-860b-1ad6f04f7dd4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:23.578629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71c78-287a-454f-860b-1ad6f04f7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:23.578934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71c78-287a-454f-860b-1ad6f04f7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:23.601169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b0e71c78-287a-454f-860b-1ad6f04f7dd4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:23.602385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b0e71c78-287a-454f-860b-1ad6f04f7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:23.611636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 738/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:23.651258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b853d-ebad-4a0b-9d08-70a192029b46 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:23.670534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b853d-ebad-4a0b-9d08-70a192029b46 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:23.677047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c36a-25db-4152-9cb8-290cf964bd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:23.678009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c36a-25db-4152-9cb8-290cf964bd15 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:23.678445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c36a-25db-4152-9cb8-290cf964bd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:23.678889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c36a-25db-4152-9cb8-290cf964bd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:23.691287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381c36a-25db-4152-9cb8-290cf964bd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:23.692747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381c36a-25db-4152-9cb8-290cf964bd15 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:23.703604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 749/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:06:26.120117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87978eb-3050-483d-b247-22e5c856ef2e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:26.120736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87978eb-3050-483d-b247-22e5c856ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:26.120736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87978eb-3050-483d-b247-22e5c856ef2e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:26.122092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 739/1488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:26.128598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5e116-c6aa-4949-9792-95457e87ce04 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:26.129307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5e116-c6aa-4949-9792-95457e87ce04 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:26.129449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5e116-c6aa-4949-9792-95457e87ce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:26.150595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3bc5e116-c6aa-4949-9792-95457e87ce04 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:26.151743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3bc5e116-c6aa-4949-9792-95457e87ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:26.160796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 750/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:26.201855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87978eb-3050-483d-b247-22e5c856ef2e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:26.214098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87978eb-3050-483d-b247-22e5c856ef2e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:26.218379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1edb-a33f-4d36-895e-808d25c38350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:26.219015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1edb-a33f-4d36-895e-808d25c38350 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:26.219309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1edb-a33f-4d36-895e-808d25c38350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:26.219559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1edb-a33f-4d36-895e-808d25c38350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:26.230396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1edb-a33f-4d36-895e-808d25c38350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:26.231883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1edb-a33f-4d36-895e-808d25c38350 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:26.241780 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 740/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:06:28.658069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a937251-930c-4981-8179-160821b5db50 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:28.658636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a937251-930c-4981-8179-160821b5db50 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:28.658636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a937251-930c-4981-8179-160821b5db50 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:28.659995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 751/1491] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jun 7 13:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:06:28.665722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a695d-5b4a-4d62-bb5e-4d6caddc2348 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:28.666183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a695d-5b4a-4d62-bb5e-4d6caddc2348 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:28.666183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a695d-5b4a-4d62-bb5e-4d6caddc2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:28.689527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-153a695d-5b4a-4d62-bb5e-4d6caddc2348 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:06:28.690894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-153a695d-5b4a-4d62-bb5e-4d6caddc2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:06:28.699577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 741/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jun 7 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:06:28.743983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a937251-930c-4981-8179-160821b5db50 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:06:28.763465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a937251-930c-4981-8179-160821b5db50 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:06:28.769729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b7188-ddaf-4f01-a3ee-885584a5c9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:06:28.770607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b7188-ddaf-4f01-a3ee-885584a5c9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:06:28.770988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b7188-ddaf-4f01-a3ee-885584a5c9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:06:28.771415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b7188-ddaf-4f01-a3ee-885584a5c9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:06:28.782488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b7188-ddaf-4f01-a3ee-885584a5c9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:06:28.783934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b7188-ddaf-4f01-a3ee-885584a5c9ff service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:06:28.794120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 752/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:06:38.684104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=33 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:38.789334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=33 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:08:00.920804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:00.922038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:00.922038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:00.950308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:08:00.951528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:00.960073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 742/1494] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:08:00.968985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:00.969546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:00.969546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:00.989545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:08:00.990764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:00.999272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 753/1495] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:08:01.004090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.014417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f140a31-46ca-48f9-8c0a-b3d393df5748 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.019072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.019729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.020009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.020285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.021040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:08:01.021359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.022388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.022388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:08:01.022388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:08:01.023268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.035089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 743/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:08:01.043592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.053126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5309b-f15f-4772-9666-4c0d173ba02d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.058396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.059059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.059341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.059609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.060289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.062106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.062106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:08:01.062106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:08:01.063289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.104389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 754/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:08:01 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:08:01.108589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.119454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123e87-e2f6-4316-82b0-4d75442341f4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.179628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.180275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.180553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.180827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.181563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.182599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.182599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:08:01.182599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:08:01.183787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.209029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 744/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:08:01 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:08:01.213455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.224224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378443d-55b9-41f1-9ccf-87773da0f82f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.229614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.230282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.230564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.230838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.231587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.232608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.232608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:08:01.232608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:08:01.233519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.247029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 755/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:08:01.251181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.262114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4dd5a-d661-455b-a91e-245626ae5471 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.266906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.267601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.267886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.268135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.268889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.269956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.269956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:08:01.269956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:08:01.270841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26151e-341a-40ee-81e9-9591134e5499 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.284870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 745/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:08:01.289203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.300017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980dfe-8a67-4336-8e11-c3be45444d26 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.305265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.306078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.306360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.306637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] PATH_INFO: `/v3/projects/d013fc3e1c9d4fb0870baa72ebfe7163/users/61d7a14304e3409cb60589b62a62ff7f/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.323601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d013fc3e1c9d4fb0870baa72ebfe7163, user_id=61d7a14304e3409cb60589b62a62ff7f, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.324647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.324647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:08:01.324647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:08:01.326614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef8571-a81a-43d7-b457-c15ed85a713d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.342422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 756/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:08:01 2022] PUT /identity/v3/projects/d013fc3e1c9d4fb0870baa72ebfe7163/users/61d7a14304e3409cb60589b62a62ff7f/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:08:01.355278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bbd0e-da47-47c3-a2f9-bf7b3acbfda5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.355558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bbd0e-da47-47c3-a2f9-bf7b3acbfda5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.355831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bbd0e-da47-47c3-a2f9-bf7b3acbfda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.387385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ef0bbd0e-da47-47c3-a2f9-bf7b3acbfda5 None None] MFA Rules not processed for user `61d7a14304e3409cb60589b62a62ff7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:08:01.388604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ef0bbd0e-da47-47c3-a2f9-bf7b3acbfda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:01.463503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 746/1502] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:08:01.477484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9012e4-44db-4bb3-8782-7b5eeba7710e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.477776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9012e4-44db-4bb3-8782-7b5eeba7710e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.478052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9012e4-44db-4bb3-8782-7b5eeba7710e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.479439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 757/1503] 10.222.0.20 () {54 vars in 963 bytes} [Tue Jun 7 13:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:08:01.485238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2777-1c28-4d2c-a19f-f83c8c978a4d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.485637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2777-1c28-4d2c-a19f-f83c8c978a4d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.485908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2777-1c28-4d2c-a19f-f83c8c978a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.505161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e6ea2777-1c28-4d2c-a19f-f83c8c978a4d None None] MFA Rules not processed for user `82194f91a6fb4600988755c126818b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:08:01.506336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e6ea2777-1c28-4d2c-a19f-f83c8c978a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:01.552983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:08:01.566403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 747/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Tue Jun 7 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:08:01.570366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9012e4-44db-4bb3-8782-7b5eeba7710e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.581940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9012e4-44db-4bb3-8782-7b5eeba7710e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.585714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.586357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.586648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.586959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.595839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.597321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.606680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 758/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:08:01.654446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a74e5b-aa44-4a3c-8229-5edafc1f7d95 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.654732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a74e5b-aa44-4a3c-8229-5edafc1f7d95 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.655007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a74e5b-aa44-4a3c-8229-5edafc1f7d95 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.656311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 748/1506] 10.222.0.20 () {52 vars in 829 bytes} [Tue Jun 7 13:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:08:01.660160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.729566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1828f-e784-46ab-97bf-6ea9ab8700f9 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:01.734935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:01.735828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.736112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.736385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] PATH_INFO: `/v3/users/61d7a14304e3409cb60589b62a62ff7f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.737721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d7a14304e3409cb60589b62a62ff7f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:01.738771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:01.738771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:08:01.738771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:08:01.739983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:01.809263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d7a14304e3409cb60589b62a62ff7f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:01.810063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d7a14304e3409cb60589b62a62ff7f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:01.810712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d7a14304e3409cb60589b62a62ff7f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:01.823061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d7a14304e3409cb60589b62a62ff7f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:01.841832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d7a14304e3409cb60589b62a62ff7f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:01.846357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:08:01.861066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 759/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:08:01 2022] DELETE /identity/v3/users/61d7a14304e3409cb60589b62a62ff7f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:08:01.865633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:01.865941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:01.866216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:01.884977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:08:01.886195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:01.947182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 749/1508] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:08:01.958771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:01.960409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:02.021259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24605f6d-798d-4f85-adee-2682ff6437c7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:02.024983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5adf-0407-472d-b064-121f574b78ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:02.025679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5adf-0407-472d-b064-121f574b78ca service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:02.025957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5adf-0407-472d-b064-121f574b78ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:02.026226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5adf-0407-472d-b064-121f574b78ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:02.035390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5adf-0407-472d-b064-121f574b78ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:02.036828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5adf-0407-472d-b064-121f574b78ca service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:02.046482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 760/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:08:02.424075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:08:02.425549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:08:02.437214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f063a6-798f-4865-8c00-af9e25054488 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:08:02.442331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:08:02.443211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:08:02.443491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:08:02.443834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] PATH_INFO: `/v3/projects/d013fc3e1c9d4fb0870baa72ebfe7163` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:08:02.445184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d013fc3e1c9d4fb0870baa72ebfe7163)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:08:02.446312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:08:02.446312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:08:02.446312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:08:02.447629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:08:02.512646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd013fc3e1c9d4fb0870baa72ebfe7163', 'request_id': 'req-65ec617a-7496-4b42-8729-45e211cc2198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:02.524516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd013fc3e1c9d4fb0870baa72ebfe7163', 'request_id': 'req-65ec617a-7496-4b42-8729-45e211cc2198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:02.530575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd013fc3e1c9d4fb0870baa72ebfe7163', 'request_id': 'req-65ec617a-7496-4b42-8729-45e211cc2198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:02.551932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] The token cache is being invalidate because project d013fc3e1c9d4fb0870baa72ebfe7163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:08:02.551932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:02.552604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-65ec617a-7496-4b42-8729-45e211cc2198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:08:02.554542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 750/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:08:02 2022] DELETE /identity/v3/projects/d013fc3e1c9d4fb0870baa72ebfe7163 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:08:12.042141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:08:12.547764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:09:40.474050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b4f8-386d-4a2a-a542-5f19022e7f86 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:40.474683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b4f8-386d-4a2a-a542-5f19022e7f86 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:40.474683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b4f8-386d-4a2a-a542-5f19022e7f86 None None] PATH_INFO: `/v3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:40.476483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 761/1511] 10.222.0.50 () {54 vars in 925 bytes} [Tue Jun 7 13:09:40 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:09:40.483721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddcdf-ceef-449f-a54b-8d459b24a044 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:40.484522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddcdf-ceef-449f-a54b-8d459b24a044 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:40.484522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddcdf-ceef-449f-a54b-8d459b24a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:40.508705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-128ddcdf-ceef-449f-a54b-8d459b24a044 None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:09:40.510351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-128ddcdf-ceef-449f-a54b-8d459b24a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:40.579174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 751/1512] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Jun 7 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:09:42.901450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1d83-28e8-47a5-b602-e3f2eb925823 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:42.902371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1d83-28e8-47a5-b602-e3f2eb925823 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:42.902371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1d83-28e8-47a5-b602-e3f2eb925823 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:42.904537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 762/1513] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:09:42.909663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead600c6-9152-4e98-99e5-d130c74f99c8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:42.910110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead600c6-9152-4e98-99e5-d130c74f99c8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:42.910211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead600c6-9152-4e98-99e5-d130c74f99c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:42.930861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ead600c6-9152-4e98-99e5-d130c74f99c8 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:09:42.932073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ead600c6-9152-4e98-99e5-d130c74f99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:42.998647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 752/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:09:43.168728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe1d83-28e8-47a5-b602-e3f2eb925823 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:09:43.171960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0cfe1d83-28e8-47a5-b602-e3f2eb925823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:43.259455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe1d83-28e8-47a5-b602-e3f2eb925823 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:09:43.265747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fafc-5beb-4acf-b28a-e8e117b49edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:09:43.266399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fafc-5beb-4acf-b28a-e8e117b49edc service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:43.266683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fafc-5beb-4acf-b28a-e8e117b49edc service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:43.266961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fafc-5beb-4acf-b28a-e8e117b49edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:43.275510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fafc-5beb-4acf-b28a-e8e117b49edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:09:43.277141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fafc-5beb-4acf-b28a-e8e117b49edc service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:09:43.286823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 763/1515] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:09:44.161468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3253-d4a8-4333-bded-fea3a21fe702 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:44.162328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3253-d4a8-4333-bded-fea3a21fe702 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:44.162328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3253-d4a8-4333-bded-fea3a21fe702 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:44.164992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 753/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:09:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:09:44.170853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1bee6-7cca-43a9-8909-04f8503b3559 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:44.171551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1bee6-7cca-43a9-8909-04f8503b3559 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:44.171659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1bee6-7cca-43a9-8909-04f8503b3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:44.200224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f8d1bee6-7cca-43a9-8909-04f8503b3559 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:09:44.201519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f8d1bee6-7cca-43a9-8909-04f8503b3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:44.211875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 764/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:09:44.374922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3253-d4a8-4333-bded-fea3a21fe702 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:09:44.392774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3253-d4a8-4333-bded-fea3a21fe702 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:09:44.399102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b0ec-1b71-4ee3-992b-aeb169358f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:09:44.399745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b0ec-1b71-4ee3-992b-aeb169358f24 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:44.400022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b0ec-1b71-4ee3-992b-aeb169358f24 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:44.400290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b0ec-1b71-4ee3-992b-aeb169358f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:44.409134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b0ec-1b71-4ee3-992b-aeb169358f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:09:44.410736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b0ec-1b71-4ee3-992b-aeb169358f24 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:09:44.420787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 754/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:09:47.631806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7735-3187-4ef5-90bf-b439e172fec9 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:47.632743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7735-3187-4ef5-90bf-b439e172fec9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:47.632743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7735-3187-4ef5-90bf-b439e172fec9 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:47.636279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 765/1519] 10.222.0.20 () {54 vars in 960 bytes} [Tue Jun 7 13:09:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:09:47.641874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495448-5c7d-4d3f-a008-5a9db94c055f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:47.642324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495448-5c7d-4d3f-a008-5a9db94c055f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:47.642415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495448-5c7d-4d3f-a008-5a9db94c055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:47.670027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-82495448-5c7d-4d3f-a008-5a9db94c055f None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:09:47.671258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-82495448-5c7d-4d3f-a008-5a9db94c055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:47.681375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 755/1520] 10.222.0.20 () {58 vars in 1057 bytes} [Tue Jun 7 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:09:47.688912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a7735-3187-4ef5-90bf-b439e172fec9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:09:47.704168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a7735-3187-4ef5-90bf-b439e172fec9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:09:47.710977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b763f4-52c8-41c6-9478-61c172db918c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:09:47.711630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b763f4-52c8-41c6-9478-61c172db918c service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:47.711913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b763f4-52c8-41c6-9478-61c172db918c service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:47.712220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b763f4-52c8-41c6-9478-61c172db918c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:47.721412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b763f4-52c8-41c6-9478-61c172db918c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:09:47.723024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b763f4-52c8-41c6-9478-61c172db918c service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:09:47.733290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 766/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:09:55.773102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eb07a-6ec3-4922-8125-39ba16139676 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:55.773849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eb07a-6ec3-4922-8125-39ba16139676 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:55.773849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eb07a-6ec3-4922-8125-39ba16139676 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:55.775999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:09:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:09:55.784662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799353f4-5b1b-4c59-b55a-b18c5647a343 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:55.785439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799353f4-5b1b-4c59-b55a-b18c5647a343 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:55.785609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799353f4-5b1b-4c59-b55a-b18c5647a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:55.807908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-799353f4-5b1b-4c59-b55a-b18c5647a343 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:09:55.809179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-799353f4-5b1b-4c59-b55a-b18c5647a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:55.820033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:09:55.984481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eb07a-6ec3-4922-8125-39ba16139676 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:09:56.010572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eb07a-6ec3-4922-8125-39ba16139676 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:09:56.017308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61995088-d056-4173-b8d8-a62d38aef14f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:09:56.017991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61995088-d056-4173-b8d8-a62d38aef14f service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:56.018276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61995088-d056-4173-b8d8-a62d38aef14f service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:56.018554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61995088-d056-4173-b8d8-a62d38aef14f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:56.028033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61995088-d056-4173-b8d8-a62d38aef14f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:09:56.029681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61995088-d056-4173-b8d8-a62d38aef14f service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:09:56.039316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 757/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:09:56.943588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2709c9d-5e22-4c85-9e4e-d8a151fe5fb1 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:56.944510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2709c9d-5e22-4c85-9e4e-d8a151fe5fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:56.944510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2709c9d-5e22-4c85-9e4e-d8a151fe5fb1 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:56.946530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 13:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:09:56.951872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ca55-91ff-4e28-af03-2ff3c697be50 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:56.952351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ca55-91ff-4e28-af03-2ff3c697be50 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:56.952444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ca55-91ff-4e28-af03-2ff3c697be50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:56.972197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2a84ca55-91ff-4e28-af03-2ff3c697be50 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:09:56.973445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2a84ca55-91ff-4e28-af03-2ff3c697be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:09:56.981971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:09:57.136608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2709c9d-5e22-4c85-9e4e-d8a151fe5fb1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:09:57.155663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2709c9d-5e22-4c85-9e4e-d8a151fe5fb1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:09:57.165148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1a8a-fb30-4834-ae34-8a1f6d9591bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:09:57.165787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1a8a-fb30-4834-ae34-8a1f6d9591bb service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:09:57.166065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1a8a-fb30-4834-ae34-8a1f6d9591bb service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:09:57.166375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1a8a-fb30-4834-ae34-8a1f6d9591bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:09:57.175430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1a8a-fb30-4834-ae34-8a1f6d9591bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:09:57.177128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1a8a-fb30-4834-ae34-8a1f6d9591bb service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:09:57.186866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 769/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:10:01.457285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa093787-3b2c-4fda-9723-e53e5d91db9a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:01.457916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa093787-3b2c-4fda-9723-e53e5d91db9a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:01.457916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa093787-3b2c-4fda-9723-e53e5d91db9a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:01.459962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:10:01.465492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1833c-be9e-4c1d-b25e-56df339993a9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:01.465973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1833c-be9e-4c1d-b25e-56df339993a9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:01.466089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1833c-be9e-4c1d-b25e-56df339993a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:01.485903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-fde1833c-be9e-4c1d-b25e-56df339993a9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:10:01.487127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fde1833c-be9e-4c1d-b25e-56df339993a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:01.495518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:10:01.532918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa093787-3b2c-4fda-9723-e53e5d91db9a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:10:01.536083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fa093787-3b2c-4fda-9723-e53e5d91db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:01.611651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa093787-3b2c-4fda-9723-e53e5d91db9a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:10:01.618226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3e3f-ac66-496f-8673-7c5f1bcd1c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:10:01.619072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3e3f-ac66-496f-8673-7c5f1bcd1c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:01.619415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3e3f-ac66-496f-8673-7c5f1bcd1c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:01.619815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3e3f-ac66-496f-8673-7c5f1bcd1c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:01.631613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3e3f-ac66-496f-8673-7c5f1bcd1c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:10:01.633060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3e3f-ac66-496f-8673-7c5f1bcd1c78 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:10:01.639026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:01.648744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 760/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:10:03.881995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae06db-cdcd-44f3-9f57-81232c67fbda None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:03.882878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae06db-cdcd-44f3-9f57-81232c67fbda None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:03.882878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae06db-cdcd-44f3-9f57-81232c67fbda None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:03.884585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:10:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:10:03.890007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7bca-dad9-4b05-b84a-ef9709058e19 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:03.890448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7bca-dad9-4b05-b84a-ef9709058e19 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:03.890553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7bca-dad9-4b05-b84a-ef9709058e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:03.909394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ecce7bca-dad9-4b05-b84a-ef9709058e19 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:10:03.910607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ecce7bca-dad9-4b05-b84a-ef9709058e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:03.918993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:10:03.954414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae06db-cdcd-44f3-9f57-81232c67fbda None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:10:03.967213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae06db-cdcd-44f3-9f57-81232c67fbda None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:10:03.971111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f8e3f-729e-4888-a292-a602ec34844b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:10:03.971749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f8e3f-729e-4888-a292-a602ec34844b service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:03.972065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f8e3f-729e-4888-a292-a602ec34844b service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:03.972341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f8e3f-729e-4888-a292-a602ec34844b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:03.981840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f8e3f-729e-4888-a292-a602ec34844b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:10:03.983244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f8e3f-729e-4888-a292-a602ec34844b service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:10:03.992750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 772/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:10:07.759543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a5e97-99e9-4d5a-8a02-44b0cb92aaef None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:07.760133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a5e97-99e9-4d5a-8a02-44b0cb92aaef None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:07.760133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a5e97-99e9-4d5a-8a02-44b0cb92aaef None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:07.761487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:10:07.767893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580a6d-280f-4563-9ce5-eccffa793b7c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:07.768323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580a6d-280f-4563-9ce5-eccffa793b7c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:07.768492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580a6d-280f-4563-9ce5-eccffa793b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:07.795466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-76580a6d-280f-4563-9ce5-eccffa793b7c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:10:07.796765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-76580a6d-280f-4563-9ce5-eccffa793b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:07.806298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:10:08.074603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a5e97-99e9-4d5a-8a02-44b0cb92aaef None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:10:08.077691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0b6a5e97-99e9-4d5a-8a02-44b0cb92aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:08.144327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a5e97-99e9-4d5a-8a02-44b0cb92aaef None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:10:08.148496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a493a-7794-4a35-85da-9f2146983962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:10:08.149259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a493a-7794-4a35-85da-9f2146983962 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:08.149636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a493a-7794-4a35-85da-9f2146983962 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:08.149915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a493a-7794-4a35-85da-9f2146983962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:08.160201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a493a-7794-4a35-85da-9f2146983962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:10:08.161672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a493a-7794-4a35-85da-9f2146983962 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:10:08.171476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 763/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:10:10.418481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f30d7-54ae-4f4f-b96f-34b6ef6eec11 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:10.419109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f30d7-54ae-4f4f-b96f-34b6ef6eec11 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:10.419109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f30d7-54ae-4f4f-b96f-34b6ef6eec11 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:10.420434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 13:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:10:10.427145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca032d-200b-4b25-9afd-eddef829c4e5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:10.427894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca032d-200b-4b25-9afd-eddef829c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:10.428066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca032d-200b-4b25-9afd-eddef829c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:10.454583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1cca032d-200b-4b25-9afd-eddef829c4e5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:10:10.456345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1cca032d-200b-4b25-9afd-eddef829c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:10.467000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:10:10.746001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f30d7-54ae-4f4f-b96f-34b6ef6eec11 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:10:10.748125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-198f30d7-54ae-4f4f-b96f-34b6ef6eec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:10:10.762955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f30d7-54ae-4f4f-b96f-34b6ef6eec11 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:10:10.766932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2752-209c-4a43-8a23-92cb6041a3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:10:10.767574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2752-209c-4a43-8a23-92cb6041a3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:10:10.767850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2752-209c-4a43-8a23-92cb6041a3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:10:10.768129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2752-209c-4a43-8a23-92cb6041a3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:10:10.777650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d2752-209c-4a43-8a23-92cb6041a3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:10:10.779092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d2752-209c-4a43-8a23-92cb6041a3cd service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:10:10.788537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 775/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:10:20.445973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=32 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:20.784804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=70 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:42.137655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c9184-1d3c-4d26-be4a-4d2f89ad8586 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.138324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c9184-1d3c-4d26-be4a-4d2f89ad8586 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.138324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c9184-1d3c-4d26-be4a-4d2f89ad8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.161799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb822a-7f83-4d7d-be59-b4ec5d43f3bc None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.162411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb822a-7f83-4d7d-be59-b4ec5d43f3bc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.162411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb822a-7f83-4d7d-be59-b4ec5d43f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.169305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1b8c9184-1d3c-4d26-be4a-4d2f89ad8586 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.170527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1b8c9184-1d3c-4d26-be4a-4d2f89ad8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.198521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 765/1540] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.200048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34803d63-6061-44ec-9a5e-aa7815a95f62 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.200338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34803d63-6061-44ec-9a5e-aa7815a95f62 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.200611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34803d63-6061-44ec-9a5e-aa7815a95f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.206222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0cbb822a-7f83-4d7d-be59-b4ec5d43f3bc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.207761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0cbb822a-7f83-4d7d-be59-b4ec5d43f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.223074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 776/1541] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.224803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7fc3-1190-478d-977b-96e75b949849 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.225330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7fc3-1190-478d-977b-96e75b949849 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.225950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7fc3-1190-478d-977b-96e75b949849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.245044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-34803d63-6061-44ec-9a5e-aa7815a95f62 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.245044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-34803d63-6061-44ec-9a5e-aa7815a95f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.258167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-159f7fc3-1190-478d-977b-96e75b949849 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.258603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 766/1542] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.259911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621dbc-a000-425e-a2ea-ce85aedcd1f6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.260194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621dbc-a000-425e-a2ea-ce85aedcd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.260445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-159f7fc3-1190-478d-977b-96e75b949849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.260574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621dbc-a000-425e-a2ea-ce85aedcd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.273829 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 777/1543] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.275481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9319-9121-45c8-a668-2bbe328149dc None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.275985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9319-9121-45c8-a668-2bbe328149dc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.276474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9319-9121-45c8-a668-2bbe328149dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.294060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-df621dbc-a000-425e-a2ea-ce85aedcd1f6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.295268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-df621dbc-a000-425e-a2ea-ce85aedcd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.304672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-92aa9319-9121-45c8-a668-2bbe328149dc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.306753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-92aa9319-9121-45c8-a668-2bbe328149dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.317611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 767/1544] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.319368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.321628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 778/1545] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.322156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.322648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.325495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56238143-e358-4ec9-a329-900942bd11ed None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.326779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56238143-e358-4ec9-a329-900942bd11ed None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.327777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56238143-e358-4ec9-a329-900942bd11ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.357521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-56238143-e358-4ec9-a329-900942bd11ed None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.359131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.359501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-56238143-e358-4ec9-a329-900942bd11ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.360411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.373678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 768/1546] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.374358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.378420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 779/1547] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.379022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56238143-e358-4ec9-a329-900942bd11ed None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.391010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56238143-e358-4ec9-a329-900942bd11ed None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.391214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b6308-7ce2-4db4-9f0b-d490fc9fe2af None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.399842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.399842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.399842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.399842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.400301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:42.400301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.400301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:42.400301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:11:42.400301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:11:42.401148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f44da-4f7c-41da-a676-b0269e0579e3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.413374 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.414069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.414352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.414626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.415338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 780/1548] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:42.415461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:42.415735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.416676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138d92-f4a0-4a93-a8d8-a5e06bf59c75 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.417113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138d92-f4a0-4a93-a8d8-a5e06bf59c75 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.417402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138d92-f4a0-4a93-a8d8-a5e06bf59c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.422112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.437821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2d138d92-f4a0-4a93-a8d8-a5e06bf59c75 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.438678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 769/1549] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:42.440844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2d138d92-f4a0-4a93-a8d8-a5e06bf59c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.440961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.451415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699445a-4d8f-4d2f-96e6-89e7fc84e31a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.453640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 781/1550] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.456355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.457043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.457346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.457749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.458490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:42.458606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9e5a9-8af0-4870-bbb3-88d26926f4f7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.458781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9e5a9-8af0-4870-bbb3-88d26926f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.458892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.459070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9e5a9-8af0-4870-bbb3-88d26926f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.460630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d97c09-51ce-499d-862a-1cb5688ac21f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.479988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 770/1551] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:42.480221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-85c9e5a9-8af0-4870-bbb3-88d26926f4f7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.480347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.480347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.480347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.480608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-85c9e5a9-8af0-4870-bbb3-88d26926f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.487516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 782/1552] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.488786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.489190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.489497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.498045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.499235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.508182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 771/1553] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.508637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.509293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.510283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.519463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbc49-cb28-4de4-bde2-5bbc119e87f4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.521829 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 783/1554] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.522752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.525577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.526561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.526988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.527418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.528441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.529703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:42.529703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:11:42.529703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:11:42.530875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.533318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5155-c662-4b64-905d-0cb9d7b2ce7d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.537901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf956b4-0c12-4b27-851c-86d04d8a8cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.538560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf956b4-0c12-4b27-851c-86d04d8a8cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.538840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf956b4-0c12-4b27-851c-86d04d8a8cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.539143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf956b4-0c12-4b27-851c-86d04d8a8cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.539867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf956b4-0c12-4b27-851c-86d04d8a8cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.541807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf956b4-0c12-4b27-851c-86d04d8a8cd3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.559644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 772/1555] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.560546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.571800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 784/1556] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.573231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82921fa5-5991-4682-8de7-c852af930706 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.574743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82921fa5-5991-4682-8de7-c852af930706 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.574743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82921fa5-5991-4682-8de7-c852af930706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.593101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-82921fa5-5991-4682-8de7-c852af930706 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.594340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-82921fa5-5991-4682-8de7-c852af930706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.630595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d63c-cf65-44ca-aad0-a297c5b4a5c4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.657027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 785/1557] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.657982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82921fa5-5991-4682-8de7-c852af930706 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.669967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82921fa5-5991-4682-8de7-c852af930706 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.675227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.676189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.676498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.676766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.677490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.679405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.692641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.693933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.694524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.694645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.695642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:42.695881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.697541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec257f-32fd-4072-b62a-844785611f8b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.711286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 786/1558] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.711286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.722797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 773/1559] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:42.722797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af86198-f788-41a8-99d2-b973579943f2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.722797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af86198-f788-41a8-99d2-b973579943f2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.722797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af86198-f788-41a8-99d2-b973579943f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.738135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9af86198-f788-41a8-99d2-b973579943f2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.739401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9af86198-f788-41a8-99d2-b973579943f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.753866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:42.791946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:42.795779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4b37-b392-4d28-b45f-9cf18d299693 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.801855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.802860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.803146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.803452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.804219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:42.804539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.806281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.810023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 774/1560] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.811329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.811614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.812458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.818746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 787/1561] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:42.821913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.830664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.831888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.832083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227afe-f553-448f-9cb6-d4984ee55cbb admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.836995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.837682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.837964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.838235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.838923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.840071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 775/1562] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.840183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:42.840183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:11:42.840183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:11:42.840655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.845587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527577dc-d93d-44ac-a292-25446904b394 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.850252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243335e-5bac-41f3-9ff1-bb1a938603cd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.856273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.857237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.857544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.857842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.858682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.861284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.867912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 788/1563] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.870510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.871030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.871239 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.882477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 776/1564] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.883288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.891228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:42.892485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:42.892641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbaab4-c66e-477e-a179-c01bd6b1eca2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.897367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.898083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.898559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.898936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.899729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.900328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 789/1565] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:42.901134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.901999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.913717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12784e35-8782-4cf5-9b1f-0a596245ae0a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.918710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.919391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.919670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.919944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.920646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.922632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.927897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 777/1566] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.927897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.935674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466664c-639a-48e9-a9a9-3f2176bf194f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:42.940469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:42.941218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:42.941441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:42.941714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:42.942452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:42.942765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:42.944367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:42.952462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 790/1567] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:42.954068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.956978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 778/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:42.958030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:42.967470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00a1c-a174-494c-be3f-4563affbecf6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.016342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b85d8-3d1b-4c4c-86af-0aecfed3ba07 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.021158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.021915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.022197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.022468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.023166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.025235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.027072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.027742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.028021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.028340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.029303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:43.029436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.030917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.049151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 779/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:43.049151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.057928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 791/1570] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:42 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.058314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d0a5-ba46-43d6-843b-0f7b4d340eea admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.058967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.115730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.116407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.116719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.116991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.117755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.119358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.120295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6145-53ae-41bb-b331-6a839a505978 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.120706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:43.125511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.126255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.126540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.126815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.127969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.129796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.132405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 780/1571] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.133217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.140491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 792/1572] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.141535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.142765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab93fa-cae2-4f6d-83a5-4ca388b147a4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.147580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.148151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.148432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.148708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.149466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:43.149771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.151343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91ec1-da2a-400a-a438-8a12b41d196c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.151463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.155839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.156485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.156764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.157120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.157844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.159423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.163647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 781/1573] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:43.164420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.174124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6dd40-89df-400b-b7f1-05a49323cefe admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.179325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 793/1574] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.179325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.181546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.182205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.182489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.182758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.183453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.185376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.187771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243477-4517-48f9-8d30-ff85645ba038 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.193369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.193715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.193996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.194242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.194921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.196991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.205927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 782/1575] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.206725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.211577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:43.219081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6660173-f58e-4fb5-a9c6-e643667fe938 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.223967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.224660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.224946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.225249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.228743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 794/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.228865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.228962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.229289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.256834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 783/1577] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.257769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.293902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a63e6-be76-4c7f-9f8d-444143ef7052 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.319489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9ce78-3f48-4147-b8d8-c29116e799f6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.324369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.325107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.325357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.325624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.326379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.327950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.338066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 784/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.339084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.349291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce2d28-c711-4638-98c1-3a7eac88e7c8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.353844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.354500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.354780 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.355054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.355778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.357395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.358010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.358691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.358970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.359243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.359938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.361912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.369789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 785/1579] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.370687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.381602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0666dc-ff5e-402c-9710-871c81bdb149 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.383303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 795/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.383303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.386613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.386831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.387116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.387391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.388089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.390076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.393435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137233f-6be9-4d06-b9a2-88332a1d9dfe admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.398446 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.399136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.399408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.399806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.400662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.402286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.412793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 796/1581] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.413635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.420274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 786/1582] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.420274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.425450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0687b-b3bc-48e0-9846-982b5b4b0cb5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.478615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d27d-e644-4501-81ab-896986bf603f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.483064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.483347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.483744 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.484029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.484140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.484306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.484399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.484589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.485175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.485511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.486803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.487571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.496697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 797/1583] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.497575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.498218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:43.509233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610633c1-5193-4a34-97ae-184e16d9b4e4 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.512614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 787/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.512614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.517573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.518257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.518543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.518821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.519524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.521550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.522937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e06f38-ad6e-4d7b-ab3b-bbc70c67f671 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.527603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.528657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.528935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.529659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] PATH_INFO: `/v3/projects/6c6b89da4e96480ba68652cff770b388/users/8b341180925b454094d9bf5e6f5b3eaf/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.537246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:43.543889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 798/1585] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/users => generated 282 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.544999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.549416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6b89da4e96480ba68652cff770b388, user_id=8b341180925b454094d9bf5e6f5b3eaf, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.550472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:43.550472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:11:43.550472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:11:43.552419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.555210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab78c1e-4086-4bd7-b430-fc3b99e3c221 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.560140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.561105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.561373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.561641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] PATH_INFO: `/v3/projects/63d29a15ba1f484fbd98c93d98b42c7e/users/e1e6349a50ec4554b27b94b3f0f2dcbd/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.567235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 788/1586] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:43 2022] PUT /identity/v3/projects/6c6b89da4e96480ba68652cff770b388/users/8b341180925b454094d9bf5e6f5b3eaf/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:43.568230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.579688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d29a15ba1f484fbd98c93d98b42c7e, user_id=e1e6349a50ec4554b27b94b3f0f2dcbd, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.582536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.597677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 799/1587] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:43 2022] PUT /identity/v3/projects/63d29a15ba1f484fbd98c93d98b42c7e/users/e1e6349a50ec4554b27b94b3f0f2dcbd/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:43.598657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.637985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f626de5-0251-4fa0-b581-7367f9138b8c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.664771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98e297-e039-4bd9-a964-3b096e2a5220 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.669282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.670187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.670471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.670754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] PATH_INFO: `/v3/projects/552bf09485dd454596b1b8267d9997b5/users/1f6257a331db41efab934c5211f71a4a/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.685065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552bf09485dd454596b1b8267d9997b5, user_id=1f6257a331db41efab934c5211f71a4a, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.687787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.694150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.694852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.695120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.695413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.696233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.697858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.701572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 800/1588] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:43 2022] PUT /identity/v3/projects/552bf09485dd454596b1b8267d9997b5/users/1f6257a331db41efab934c5211f71a4a/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:43.702443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.708129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 789/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.711877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.721945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b64043-8c62-4a5b-bf4c-aa90168284d4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.774313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b832d-282c-48d4-8acd-185b581b2f01 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.778958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.779396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.779629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.779912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.780186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.780310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.780652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.780884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.781062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.781848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.782917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.783519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.793679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 790/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.794507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.804224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edba89-74c4-47fc-92e1-4e94931a6f92 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.807147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 801/1591] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:43.807969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.811787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d209df-9d9f-42c0-88a1-ec49c7415b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.812552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d209df-9d9f-42c0-88a1-ec49c7415b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.812903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d209df-9d9f-42c0-88a1-ec49c7415b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.813332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d209df-9d9f-42c0-88a1-ec49c7415b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.814167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d209df-9d9f-42c0-88a1-ec49c7415b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.815855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d209df-9d9f-42c0-88a1-ec49c7415b2b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.817753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d0cd-83d2-48e3-b6f2-a89bed7d62fb admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.821429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:43.824007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be407c7-40ab-4ca2-b7a8-ca265d47e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.824579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be407c7-40ab-4ca2-b7a8-ca265d47e536 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.824878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be407c7-40ab-4ca2-b7a8-ca265d47e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.825188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be407c7-40ab-4ca2-b7a8-ca265d47e536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.825933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be407c7-40ab-4ca2-b7a8-ca265d47e536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.830553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be407c7-40ab-4ca2-b7a8-ca265d47e536 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.830722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 791/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.830722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.830722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.830722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.842656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 802/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.842656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a78a6-595d-4bb4-9bbf-268201f03e6b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.842656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a78a6-595d-4bb4-9bbf-268201f03e6b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.842656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a78a6-595d-4bb4-9bbf-268201f03e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.848600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:43.849958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:43.857540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 792/1594] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:43.858395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.859451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d43a78a6-595d-4bb4-9bbf-268201f03e6b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:43.861635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d43a78a6-595d-4bb4-9bbf-268201f03e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:43.868240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733402b3-ad6f-4453-8a40-46c4cd928e7c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.869618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 803/1595] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:43.870861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.871148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.871424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.876117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.877055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.877432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.878150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.878988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.880779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.891204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 793/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:43.892230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.898467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] MFA Rules not processed for user `1f6257a331db41efab934c5211f71a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:43.899663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:43.901982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfa7d-16b8-4cb9-a63e-a92785126161 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:43.906546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:43.907424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:43.907698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:43.907971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] PATH_INFO: `/v3/projects/f9cf247a413d45049be49368cbce7213/users/025ca1d10d5e49e984c7fd4e0b425f08/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:43.916283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:43.924619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cf247a413d45049be49368cbce7213, user_id=025ca1d10d5e49e984c7fd4e0b425f08, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:43.927600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:43.942322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 794/1597] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:43 2022] PUT /identity/v3/projects/f9cf247a413d45049be49368cbce7213/users/025ca1d10d5e49e984c7fd4e0b425f08/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:43.943216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.969246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 804/1598] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:43.973619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:43.984070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5dbc0-190a-4e29-a529-bf93daeff8ab None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.008370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375ec8b-c759-4e80-b828-18510efb48a2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.012938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.013644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.013925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.014198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.014932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.016713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.026811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 795/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:44.027617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.037093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d16d3-cdc1-4f44-8f39-83405dade2c3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.041696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.041885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.042371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.042500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.042658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.042765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.042920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.043022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.043727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.043886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.045383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.045506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.056329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 805/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:44.056505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 796/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:44.056928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.057434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.114648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cb088-7ddb-4a58-9976-79b971889b20 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.114877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc98e-42e0-4479-ab66-6c3c3df925d1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.118475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266bf4-00f5-49c7-a419-bdd8a5694f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.118644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.119128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266bf4-00f5-49c7-a419-bdd8a5694f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.119225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.119432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.119543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266bf4-00f5-49c7-a419-bdd8a5694f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.119730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.119903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266bf4-00f5-49c7-a419-bdd8a5694f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.129776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.130693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266bf4-00f5-49c7-a419-bdd8a5694f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.131228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.132121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266bf4-00f5-49c7-a419-bdd8a5694f1c service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.141364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 806/1602] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:44.142415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.143288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 797/1603] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:44.145097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.145535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.145988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.152110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb24a27-426e-407f-9d31-a7f41070309d service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.156756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.157752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.158034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.158306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] PATH_INFO: `/v3/projects/51f8af298f254243bd24dcde1446cc53/users/4a8f7b67f051449786eb00d1bc979a09/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.168670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:44.176599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:44.179727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f8af298f254243bd24dcde1446cc53, user_id=4a8f7b67f051449786eb00d1bc979a09, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.182557 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.186933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 798/1604] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:44.190392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.199945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394985ca-5391-4337-b7cc-2a2b6c540c2e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.204176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 807/1605] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:44 2022] PUT /identity/v3/projects/51f8af298f254243bd24dcde1446cc53/users/4a8f7b67f051449786eb00d1bc979a09/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:44.205041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.244315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.254268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.277857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.278319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026b0d6-915a-4d22-9411-87e7b199ec93 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.278541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.278826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.279103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.279811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.281932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.283545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.284484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.284764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.285064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.285799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.287395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.299845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 808/1606] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:44.300723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.312209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c944b6-dc0f-406b-9979-619603d2e885 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.315479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 799/1607] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:44.315479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.386870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.387155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299ff5-3dca-446a-811e-c9dce7be2fa3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.388538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.389190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.389570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] PATH_INFO: `/v3/projects/1a2b054728c147788d7a6f5b2b2645be/users/f7389e6ff75a4cfbbdaf444906611f96/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.391787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5312-b3ab-416e-a036-832a49ab5d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.392722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5312-b3ab-416e-a036-832a49ab5d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.393004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5312-b3ab-416e-a036-832a49ab5d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.393310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5312-b3ab-416e-a036-832a49ab5d1f admin admin] PATH_INFO: `/v3/projects/4472862ab62042c7ba390ab73d6bce06/users/e9c33515f3f9431d853b38f9c06dd4d1/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.408872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2b054728c147788d7a6f5b2b2645be, user_id=f7389e6ff75a4cfbbdaf444906611f96, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.411317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5312-b3ab-416e-a036-832a49ab5d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4472862ab62042c7ba390ab73d6bce06, user_id=e9c33515f3f9431d853b38f9c06dd4d1, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.411596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.414363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5312-b3ab-416e-a036-832a49ab5d1f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.442210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 809/1608] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:44 2022] PUT /identity/v3/projects/1a2b054728c147788d7a6f5b2b2645be/users/f7389e6ff75a4cfbbdaf444906611f96/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:44.442441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 800/1609] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:44 2022] PUT /identity/v3/projects/4472862ab62042c7ba390ab73d6bce06/users/e9c33515f3f9431d853b38f9c06dd4d1/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:44.442532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.442620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.442620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.442620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.446423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:44.466820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] MFA Rules not processed for user `4a8f7b67f051449786eb00d1bc979a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:44.468167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:44.533607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d6ac0-4434-4069-b546-5d4416c23f4b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.542638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 801/1610] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:44.543790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.593590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.601035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011cd3b-c4c8-4875-bb44-3fef17b902f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.601607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011cd3b-c4c8-4875-bb44-3fef17b902f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.601903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011cd3b-c4c8-4875-bb44-3fef17b902f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.602166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011cd3b-c4c8-4875-bb44-3fef17b902f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.620323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d9f9-ac5c-4dcd-bcea-23862d3e1900 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.624984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.625967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.626249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.626724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] PATH_INFO: `/v3/projects/3f90a27e69c7441ea20216b40281fdba/users/bc103ff7fb9342179a7ce6404315afed/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.633577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.642711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f90a27e69c7441ea20216b40281fdba, user_id=bc103ff7fb9342179a7ce6404315afed, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.645382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.664524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 802/1611] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:44 2022] PUT /identity/v3/projects/3f90a27e69c7441ea20216b40281fdba/users/bc103ff7fb9342179a7ce6404315afed/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:44.665499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.695981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011cd3b-c4c8-4875-bb44-3fef17b902f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.699525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011cd3b-c4c8-4875-bb44-3fef17b902f2 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.715495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 810/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:44.717211 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.717501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.717923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.739817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed038a6-3845-4800-87cc-65e5627f39a3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.746917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc884-6a47-4bcf-8bde-672a465ac9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.748585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc884-6a47-4bcf-8bde-672a465ac9de admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.748974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc884-6a47-4bcf-8bde-672a465ac9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.749464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc884-6a47-4bcf-8bde-672a465ac9de admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.750315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc884-6a47-4bcf-8bde-672a465ac9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.754463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] MFA Rules not processed for user `f7389e6ff75a4cfbbdaf444906611f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:44.754790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbc884-6a47-4bcf-8bde-672a465ac9de admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.755688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:44.804719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 803/1613] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:44.812615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.814072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.814575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.832786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 811/1614] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:44.832786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:44.842691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a561-f7f7-4177-ae04-cdc19064df56 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:44.849329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e27f1-3222-49a4-84a0-a63b40cc9bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:44.853505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e27f1-3222-49a4-84a0-a63b40cc9bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.853505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e27f1-3222-49a4-84a0-a63b40cc9bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.853505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e27f1-3222-49a4-84a0-a63b40cc9bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.854444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e27f1-3222-49a4-84a0-a63b40cc9bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:44.857295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e27f1-3222-49a4-84a0-a63b40cc9bbf admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:44.894900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] MFA Rules not processed for user `e9c33515f3f9431d853b38f9c06dd4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:44.896644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:44.900959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 812/1615] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:44.902490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513b43-bdba-49af-907c-56ddc69c2dda None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:44.902785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513b43-bdba-49af-907c-56ddc69c2dda None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:44.903072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513b43-bdba-49af-907c-56ddc69c2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:44.927209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-04513b43-bdba-49af-907c-56ddc69c2dda None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:44.928589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-04513b43-bdba-49af-907c-56ddc69c2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:44.991024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 804/1616] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:44.992128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.064772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 813/1617] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:45.067543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3057e-dc5c-4d9f-b619-26f7aab00b67 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.069344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3057e-dc5c-4d9f-b619-26f7aab00b67 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.069344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3057e-dc5c-4d9f-b619-26f7aab00b67 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.071501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 814/1618] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jun 7 13:11:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:11:45.072351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3057e-dc5c-4d9f-b619-26f7aab00b67 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.077498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:45.092781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3057e-dc5c-4d9f-b619-26f7aab00b67 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.098882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54578561-73d6-4a17-b135-eb345dd096ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.100053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54578561-73d6-4a17-b135-eb345dd096ed admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.100604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54578561-73d6-4a17-b135-eb345dd096ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.101128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54578561-73d6-4a17-b135-eb345dd096ed admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.102240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54578561-73d6-4a17-b135-eb345dd096ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.104941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54578561-73d6-4a17-b135-eb345dd096ed admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.110428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f96c8-5b0d-4e5f-b3ea-d5853fd74386 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.118023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.118761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.119140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.119811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.120813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.123365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.138650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 805/1619] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:45.138650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.138932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 815/1620] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:45 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:45.139125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.139490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.139871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.151698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcab19-0c8a-42bc-a8b2-8663c03a90ca admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.158306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.159362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.159481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.160172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.160685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.163460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.165675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:45.166899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:45.172576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:45.204601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 806/1621] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:45 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:45.205630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.297298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff163-9455-4395-9e3c-bc0e4c3a3c49 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.303063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.304384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.305044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.305316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.312887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 816/1622] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jun 7 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:45.313766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.331183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f9534-0fed-4c90-a23a-b7998498aa6c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.396128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.396972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.397331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.397613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.398360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.399985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.412467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 817/1623] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:45.413620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.421069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.423494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.424877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711aa6a-1c1b-4e37-a6f7-5486b85b747f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.430283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.431204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.431475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.431787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] PATH_INFO: `/v3/projects/f2715d1984e243a6bb22cbdae4a3f1c7/users/1fa8ad6895b143a6aebf8c6151f81b1d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.438675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 807/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:45.439624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.457107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718485c5-dded-4dac-aba4-5a4bd2482ebe service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.457645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2715d1984e243a6bb22cbdae4a3f1c7, user_id=1fa8ad6895b143a6aebf8c6151f81b1d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.461295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.462528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.463359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.463771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.464188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.465103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.467394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.490795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 818/1625] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:45 2022] PUT /identity/v3/projects/f2715d1984e243a6bb22cbdae4a3f1c7/users/1fa8ad6895b143a6aebf8c6151f81b1d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:45.491477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.500228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 808/1626] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:45 2022] POST /identity/v3/users => generated 289 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:45.505514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.553196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070e2d1-ecd0-49b0-b88c-c4b9a4476f64 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.614125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012f45-cbdf-4d4a-a1b1-e595ff31f3b1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.621802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.622532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.622905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.623226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.634010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:45.643270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:45.669121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.671154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.671548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.671832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] PATH_INFO: `/v3/projects/a2734dc7a059428586d827c52c3f0f05/users/6c195fdb8a534a70a2b46f08a6b9b94e/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.708285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2734dc7a059428586d827c52c3f0f05, user_id=6c195fdb8a534a70a2b46f08a6b9b94e, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.717548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.724430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.726101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.747783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 809/1627] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:45 2022] PUT /identity/v3/projects/a2734dc7a059428586d827c52c3f0f05/users/6c195fdb8a534a70a2b46f08a6b9b94e/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:45.749646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.754426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 819/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:45.769920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.807041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1162f1d-1db7-4754-80de-990371535f7e service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.906434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c225bfe-e9a8-478e-8a45-69872447dbfe admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.907122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.908230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.908230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.908470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.909208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.911102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.912653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.913627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.913627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.914314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.915072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.916667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.929592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 820/1629] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:45.931741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.935742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 810/1630] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:45.939505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:45.950493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62c1b-77bc-45d8-aef5-32f13baec117 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.955915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.956827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.957130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.957406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] PATH_INFO: `/v3/projects/9ce2da831855494781d011e4b3c09d2e/users/d3b0cf071c134166ab5a0bb9e925465a/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.957684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6438f-8710-43ea-a94d-0e3ba4343485 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:45.974200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:45.974200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:45.974200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:45.974707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:45.975194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.976040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce2da831855494781d011e4b3c09d2e, user_id=d3b0cf071c134166ab5a0bb9e925465a, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:45.978954 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:45.979425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.001134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 821/1631] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:46.001134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.003316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 811/1632] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:45 2022] PUT /identity/v3/projects/9ce2da831855494781d011e4b3c09d2e/users/d3b0cf071c134166ab5a0bb9e925465a/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:46.007429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.013392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1c314-8482-451f-9d89-19c3bd6ff98e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.097228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.098623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.099223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.099660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] PATH_INFO: `/v3/projects/f2715d1984e243a6bb22cbdae4a3f1c7/users/1fa8ad6895b143a6aebf8c6151f81b1d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.102797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2715d1984e243a6bb22cbdae4a3f1c7, user_id=1fa8ad6895b143a6aebf8c6151f81b1d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.106751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.123210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 822/1633] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:45 2022] PUT /identity/v3/projects/f2715d1984e243a6bb22cbdae4a3f1c7/users/1fa8ad6895b143a6aebf8c6151f81b1d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:46.124745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.164448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a2078-12f9-483e-a257-2478523c4802 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.176727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:46.245947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc90a7-265a-412e-a3cc-e5a59424ae35 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.251706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b875b8-64d9-47a4-9a16-629a6a8adaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.253323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b875b8-64d9-47a4-9a16-629a6a8adaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.253486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:46.253759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b875b8-64d9-47a4-9a16-629a6a8adaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.254150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b875b8-64d9-47a4-9a16-629a6a8adaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.255215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b875b8-64d9-47a4-9a16-629a6a8adaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.257587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b875b8-64d9-47a4-9a16-629a6a8adaa6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.270954 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.274970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 823/1634] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:46.274970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c339-1020-4e81-a867-ac58372aae2b None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.274970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c339-1020-4e81-a867-ac58372aae2b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.274970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c339-1020-4e81-a867-ac58372aae2b None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.277261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 824/1635] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jun 7 13:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:11:46.278316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.278795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.279351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] PATH_INFO: `/v3/projects/a2734dc7a059428586d827c52c3f0f05/users/6c195fdb8a534a70a2b46f08a6b9b94e/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.279469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d361-0150-4a57-81f4-9162b2fbdb15 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.280192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d361-0150-4a57-81f4-9162b2fbdb15 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.280320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d361-0150-4a57-81f4-9162b2fbdb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.284427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2734dc7a059428586d827c52c3f0f05, user_id=6c195fdb8a534a70a2b46f08a6b9b94e, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.289685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.312495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 812/1636] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:46 2022] PUT /identity/v3/projects/a2734dc7a059428586d827c52c3f0f05/users/6c195fdb8a534a70a2b46f08a6b9b94e/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:46.315226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.326935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f0f7d361-0150-4a57-81f4-9162b2fbdb15 None None] MFA Rules not processed for user `1fa8ad6895b143a6aebf8c6151f81b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:46.328848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f0f7d361-0150-4a57-81f4-9162b2fbdb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:46.412828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad15b87-77ba-4990-9892-4acda4ef3852 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.419506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b2e2-1eaa-4c49-803c-015260f87ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.420759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b2e2-1eaa-4c49-803c-015260f87ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.421565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b2e2-1eaa-4c49-803c-015260f87ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.422024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b2e2-1eaa-4c49-803c-015260f87ffb admin admin] PATH_INFO: `/v3/projects/9ce2da831855494781d011e4b3c09d2e/users/d3b0cf071c134166ab5a0bb9e925465a/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.424511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b2e2-1eaa-4c49-803c-015260f87ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce2da831855494781d011e4b3c09d2e, user_id=d3b0cf071c134166ab5a0bb9e925465a, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.428961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b2e2-1eaa-4c49-803c-015260f87ffb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.443221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 813/1637] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:46 2022] PUT /identity/v3/projects/9ce2da831855494781d011e4b3c09d2e/users/d3b0cf071c134166ab5a0bb9e925465a/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:46.444973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95b94-88b1-49fb-98ee-eb46108dd74f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.445655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95b94-88b1-49fb-98ee-eb46108dd74f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.446573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95b94-88b1-49fb-98ee-eb46108dd74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.449422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 825/1638] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:46.451040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.451331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.451603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.485935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0ac95b94-88b1-49fb-98ee-eb46108dd74f None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:46.486973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0ac95b94-88b1-49fb-98ee-eb46108dd74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:46.506470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] MFA Rules not processed for user `6c195fdb8a534a70a2b46f08a6b9b94e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:46.509158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:46.596555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 814/1639] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:46.598575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.599204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.599547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.617654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 826/1640] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:46.624019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.636023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] MFA Rules not processed for user `d3b0cf071c134166ab5a0bb9e925465a`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:46.637774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:46.680349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:46.714854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d071b8c-ffe2-4c17-8b55-348feccf40cc None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.721752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.724596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.725816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.726390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.732703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:46.755559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 815/1641] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:46.756802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.767926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9820db0-4f6b-4145-91e2-9ceff12ef954 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.772242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.773445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.774254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.774724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.789463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.791154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.803904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 816/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:46.849344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.850951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:46.869231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 827/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:46.936349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:46.947188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d24dd-df9e-44f2-9d99-d09bd18c11f5 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:46.953305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:46.954542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:46.955335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:46.955844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:46.968415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:46.971503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:47.001109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 817/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:47.062593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:47.080575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9f0d-5bb8-46a1-9511-4b925e0db670 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:47.085993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b27d2-3917-4673-8cf5-cf260fee5b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:47.088440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b27d2-3917-4673-8cf5-cf260fee5b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:47.089346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b27d2-3917-4673-8cf5-cf260fee5b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:47.089673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b27d2-3917-4673-8cf5-cf260fee5b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:47.106672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b27d2-3917-4673-8cf5-cf260fee5b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:47.113157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b27d2-3917-4673-8cf5-cf260fee5b97 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:47.147354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 828/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:47.456440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:47.469700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaec1d1-1871-4c29-85e0-1e1ab2f8454e service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:47.475951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a785-c511-406e-b9e8-20cdb4686472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:47.476954 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a785-c511-406e-b9e8-20cdb4686472 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:47.477275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a785-c511-406e-b9e8-20cdb4686472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:47.477563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a785-c511-406e-b9e8-20cdb4686472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:47.560133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a785-c511-406e-b9e8-20cdb4686472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:47.580119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a785-c511-406e-b9e8-20cdb4686472 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:47.630166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 818/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:48.525987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775ce6-9a21-4704-bb35-4c1d94ebd35e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.526648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775ce6-9a21-4704-bb35-4c1d94ebd35e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.526863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775ce6-9a21-4704-bb35-4c1d94ebd35e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.529662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 829/1647] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jun 7 13:11:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:11:48.556277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.556799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.556891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.617316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:48.622368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:48.646781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997797-dd31-4504-a7be-4e2aa9d19383 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.647128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997797-dd31-4504-a7be-4e2aa9d19383 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.647404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997797-dd31-4504-a7be-4e2aa9d19383 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.649052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 830/1648] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jun 7 13:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:11:48.655337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.655655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.655991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.660316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 819/1649] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jun 7 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:48.710920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:48.711957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:48.712174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:48.757525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 831/1650] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:11:48.771679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:48.795382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc21e0-a211-4b00-afda-3b76e014c547 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:48.808792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b0843-459a-4417-9ad2-3ac4a1ceda0a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:48.813922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:48.814876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.815164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.815612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] PATH_INFO: `/v3/users/1f6257a331db41efab934c5211f71a4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.815808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:48.816871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6257a331db41efab934c5211f71a4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:48.817964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: WARNING py.warnings [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:48.817964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: warnings.warn(msg) Jun 07 13:11:48.817964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: Jun 07 13:11:48.819232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:48.819430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.819870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.826575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.867843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:48.869342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:48.899949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 832/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:48.901073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:48.938741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac943-85e7-4fcb-a9f2-369d68b46acf service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:48.959394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:48.960806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:48.961526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:48.961905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] PATH_INFO: `/v3/users/e9c33515f3f9431d853b38f9c06dd4d1` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:48.965277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c33515f3f9431d853b38f9c06dd4d1)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:48.967636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:49.002201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6257a331db41efab934c5211f71a4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.012825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6257a331db41efab934c5211f71a4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.013712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6257a331db41efab934c5211f71a4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.040635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6257a331db41efab934c5211f71a4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.069517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:49.108584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9d3bb00f-8531-494a-ae61-f85f112b0118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6257a331db41efab934c5211f71a4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.139383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c33515f3f9431d853b38f9c06dd4d1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.140375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c33515f3f9431d853b38f9c06dd4d1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.141141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c33515f3f9431d853b38f9c06dd4d1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.157064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 820/1652] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:48 2022] DELETE /identity/v3/users/1f6257a331db41efab934c5211f71a4a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:49.157336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c33515f3f9431d853b38f9c06dd4d1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.166532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1616dff-2fab-4873-a30a-456746cff279 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:49.217969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1616dff-2fab-4873-a30a-456746cff279 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:49.217969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1616dff-2fab-4873-a30a-456746cff279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:49.219301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3706ec94-12ee-46eb-b44c-41c275f1a77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c33515f3f9431d853b38f9c06dd4d1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:49.232813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 833/1653] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:48 2022] DELETE /identity/v3/users/e9c33515f3f9431d853b38f9c06dd4d1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:49.237924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:49.240228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:49.240661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:49.263081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c1616dff-2fab-4873-a30a-456746cff279 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:49.264310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c1616dff-2fab-4873-a30a-456746cff279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:49.292361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:49.299628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:49.360044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:49.443232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 821/1654] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:49.444630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:49.444914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:49.445225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:49.453429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 834/1655] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:49.524864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:49.526884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:49.593220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] MFA Rules not processed for user `bc103ff7fb9342179a7ce6404315afed`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:49.597596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:49.738122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decb41d-6c60-4494-ba5e-2f7561c2400d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:49.751049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 822/1656] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:49.752228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:49.755351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94728d3e-3f9b-4f02-bd97-5fe88cc8ea00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:49.756034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728d3e-3f9b-4f02-bd97-5fe88cc8ea00 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:49.756325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728d3e-3f9b-4f02-bd97-5fe88cc8ea00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:49.756607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728d3e-3f9b-4f02-bd97-5fe88cc8ea00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:49.773270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea57a6-3518-4306-8489-afee3563cc3e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:49.777870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:49.778863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:49.779336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:49.779809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:49.795909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94728d3e-3f9b-4f02-bd97-5fe88cc8ea00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:49.797596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94728d3e-3f9b-4f02-bd97-5fe88cc8ea00 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:49.809179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:49.812193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:49.821101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 835/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:49.823709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:49.833116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:49.833703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:49.856255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 823/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:49.886547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] MFA Rules not processed for user `bc103ff7fb9342179a7ce6404315afed`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:49.888213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:49.900507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 836/1659] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:49.916126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:49.920373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:50.028993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:50.097321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb858-0a43-42bf-8c86-bd07a043d66a service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:50.120897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175f1fc-0683-46ea-9dab-6dd93b744803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:50.122355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175f1fc-0683-46ea-9dab-6dd93b744803 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:50.122937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175f1fc-0683-46ea-9dab-6dd93b744803 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:50.123379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175f1fc-0683-46ea-9dab-6dd93b744803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:50.139777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175f1fc-0683-46ea-9dab-6dd93b744803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:50.142481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175f1fc-0683-46ea-9dab-6dd93b744803 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:50.180885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 824/1660] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:50.772150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:50.775724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:50.807168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c462c-e26e-4d04-8994-5247092c28cd None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:50.845875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:50.848155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:50.848700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:50.849136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] PATH_INFO: `/v3/users/f7389e6ff75a4cfbbdaf444906611f96` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:50.851457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7389e6ff75a4cfbbdaf444906611f96)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:50.853640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:50.959711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7389e6ff75a4cfbbdaf444906611f96'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:50.960549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7389e6ff75a4cfbbdaf444906611f96'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:50.961237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7389e6ff75a4cfbbdaf444906611f96'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:50.971039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7389e6ff75a4cfbbdaf444906611f96'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:50.988276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7389e6ff75a4cfbbdaf444906611f96'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.010594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 837/1661] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:50 2022] DELETE /identity/v3/users/f7389e6ff75a4cfbbdaf444906611f96 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:51.016716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:51.017347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:51.017639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:51.044386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:51.045744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:51.108600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:51.110862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:51.165659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 825/1662] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:11:51.166708 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:51.172957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:51.198856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7f4ed-3085-4890-a68b-14b572089a65 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:51.200650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:51.209349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:51.210681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:51.211041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:51.211408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] PATH_INFO: `/v3/projects/4472862ab62042c7ba390ab73d6bce06` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:51.215279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4472862ab62042c7ba390ab73d6bce06)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:51.218956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:51.286156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ac31-5a10-402a-945f-db8d4bfcd91c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:51.299128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:51.300114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:51.300392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:51.300666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] PATH_INFO: `/v3/projects/552bf09485dd454596b1b8267d9997b5` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:51.302212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552bf09485dd454596b1b8267d9997b5)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:51.304889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: WARNING py.warnings [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:11:51.304889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: warnings.warn(msg) Jun 07 13:11:51.304889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: Jun 07 13:11:51.314787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:51.373510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4472862ab62042c7ba390ab73d6bce06', 'request_id': 'req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.393491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4472862ab62042c7ba390ab73d6bce06', 'request_id': 'req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.417435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4472862ab62042c7ba390ab73d6bce06', 'request_id': 'req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.446727 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] The token cache is being invalidate because project 4472862ab62042c7ba390ab73d6bce06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:51.446982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.449132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.451255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 826/1663] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:51 2022] DELETE /identity/v3/projects/4472862ab62042c7ba390ab73d6bce06 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:51.456442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:51.459970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:51.538483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552bf09485dd454596b1b8267d9997b5', 'request_id': 'req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.569388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552bf09485dd454596b1b8267d9997b5', 'request_id': 'req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.585945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552bf09485dd454596b1b8267d9997b5', 'request_id': 'req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.631661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] The token cache is being invalidate because project 552bf09485dd454596b1b8267d9997b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:51.641684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.642782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e28cf8da-4ffe-4ab7-b3f3-3b5e50c7d765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:51.656517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f307e-aa65-4205-9c3b-9dc297cbdc06 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:51.661341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 838/1664] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:51 2022] DELETE /identity/v3/projects/552bf09485dd454596b1b8267d9997b5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:51.666512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadbe2-261f-4612-81e2-f3eb5507c71e None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:51.666800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadbe2-261f-4612-81e2-f3eb5507c71e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:51.667084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadbe2-261f-4612-81e2-f3eb5507c71e None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:51.677387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 839/1665] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jun 7 13:11:51 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:11:51.678378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cadbe2-261f-4612-81e2-f3eb5507c71e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:51.690904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-64cadbe2-261f-4612-81e2-f3eb5507c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:51.692482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:51.796887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:51.797726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:51.798014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:51.798295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:51.808575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:51.929606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cadbe2-261f-4612-81e2-f3eb5507c71e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:51.949439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:51.950373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:51.950652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:51.950963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] PATH_INFO: `/v3/users/d3b0cf071c134166ab5a0bb9e925465a` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:51.952577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b0cf071c134166ab5a0bb9e925465a)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:51.959769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:52.048855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:52.050385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:52.062485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 827/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:52.068511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:52.070320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:52.103997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b0cf071c134166ab5a0bb9e925465a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.104728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df0438-36ec-4cd2-8c4b-094b8d322ed8 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:52.105797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b0cf071c134166ab5a0bb9e925465a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.106900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b0cf071c134166ab5a0bb9e925465a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.117638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:52.119067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b0cf071c134166ab5a0bb9e925465a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.120561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:52.120841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:52.121145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] PATH_INFO: `/v3/users/1fa8ad6895b143a6aebf8c6151f81b1d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:52.124181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa8ad6895b143a6aebf8c6151f81b1d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:52.130051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:52.136682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:52.151349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9c35685e-ebdd-4ca2-81d9-99e591eba56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b0cf071c134166ab5a0bb9e925465a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.186519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 840/1667] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:51 2022] DELETE /identity/v3/users/d3b0cf071c134166ab5a0bb9e925465a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:52.188357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beab30d-c402-4743-a314-391376721ef7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:52.188655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beab30d-c402-4743-a314-391376721ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:52.189260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beab30d-c402-4743-a314-391376721ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:52.253950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa8ad6895b143a6aebf8c6151f81b1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.254662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1beab30d-c402-4743-a314-391376721ef7 None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:52.254846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa8ad6895b143a6aebf8c6151f81b1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.255556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa8ad6895b143a6aebf8c6151f81b1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.256469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1beab30d-c402-4743-a314-391376721ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:52.273793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa8ad6895b143a6aebf8c6151f81b1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.308222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa8ad6895b143a6aebf8c6151f81b1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.340666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 828/1668] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:52 2022] DELETE /identity/v3/users/1fa8ad6895b143a6aebf8c6151f81b1d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:52.343016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:52.346493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:52.356493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 841/1669] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:52.393771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beab30d-c402-4743-a314-391376721ef7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:52.395970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1beab30d-c402-4743-a314-391376721ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:52.412087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beab30d-c402-4743-a314-391376721ef7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:52.459922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:52.497729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09455-ba1d-4b70-8051-b85d3b071962 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:52.510233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:52.511512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:52.511894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:52.512138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] PATH_INFO: `/v3/users/4a8f7b67f051449786eb00d1bc979a09` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:52.513710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8f7b67f051449786eb00d1bc979a09)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:52.522545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:52.535985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b469ce-9a53-4abc-86a3-54792de57212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:52.537440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b469ce-9a53-4abc-86a3-54792de57212 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:52.537934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b469ce-9a53-4abc-86a3-54792de57212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:52.538878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b469ce-9a53-4abc-86a3-54792de57212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:52.560640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b469ce-9a53-4abc-86a3-54792de57212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:52.567898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b469ce-9a53-4abc-86a3-54792de57212 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:52.615282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 842/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:11:52.628526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8f7b67f051449786eb00d1bc979a09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.630575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8f7b67f051449786eb00d1bc979a09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.631624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8f7b67f051449786eb00d1bc979a09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.651076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8f7b67f051449786eb00d1bc979a09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.683227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8f7b67f051449786eb00d1bc979a09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:52.714184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 829/1671] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:52 2022] DELETE /identity/v3/users/4a8f7b67f051449786eb00d1bc979a09 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:52.719663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:52.722319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:52.723601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:52.790085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:52.793584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:52.906923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 843/1672] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:52.961884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:52.963735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.104632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42ecf-7b2d-4885-957c-0d821209dd65 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.111165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.112649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.112931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.113271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.128017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.129546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:53.142430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 830/1673] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:53.423777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:53.425346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.443598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91cfc-6dc9-4639-af34-2ca58de84a77 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.461078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.462010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.462295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.462574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] PATH_INFO: `/v3/projects/1a2b054728c147788d7a6f5b2b2645be` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.463846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2b054728c147788d7a6f5b2b2645be)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.465963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:53.504723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:53.514607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:53.516208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.539144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7e431-d1fc-49dd-a108-a9221d35a5bf service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.557158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.558188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.558389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.558633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] PATH_INFO: `/v3/projects/9ce2da831855494781d011e4b3c09d2e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.561002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce2da831855494781d011e4b3c09d2e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.563297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:53.580176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2b054728c147788d7a6f5b2b2645be', 'request_id': 'req-31621edc-6f74-4ee2-b6e3-923b1319b159'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.593219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2b054728c147788d7a6f5b2b2645be', 'request_id': 'req-31621edc-6f74-4ee2-b6e3-923b1319b159'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.603135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2b054728c147788d7a6f5b2b2645be', 'request_id': 'req-31621edc-6f74-4ee2-b6e3-923b1319b159'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.623565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] The token cache is being invalidate because project 1a2b054728c147788d7a6f5b2b2645be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:53.623972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.624721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-31621edc-6f74-4ee2-b6e3-923b1319b159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.632530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 844/1674] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:53 2022] DELETE /identity/v3/projects/1a2b054728c147788d7a6f5b2b2645be => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:53.634759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f04c-b9c4-4bbc-8441-5b673c4cc1f0 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.635117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f04c-b9c4-4bbc-8441-5b673c4cc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.635463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f04c-b9c4-4bbc-8441-5b673c4cc1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.670727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f4c4f04c-b9c4-4bbc-8441-5b673c4cc1f0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:53.672791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f4c4f04c-b9c4-4bbc-8441-5b673c4cc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.683379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce2da831855494781d011e4b3c09d2e', 'request_id': 'req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.712520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce2da831855494781d011e4b3c09d2e', 'request_id': 'req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.715614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:53.720166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce2da831855494781d011e4b3c09d2e', 'request_id': 'req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.751920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] The token cache is being invalidate because project 9ce2da831855494781d011e4b3c09d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:53.753907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.754037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ff0adbe0-eb0d-440d-9b56-fabad7d1785f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:53.756132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 831/1675] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:53 2022] DELETE /identity/v3/projects/9ce2da831855494781d011e4b3c09d2e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:11:53.761093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36904b6-10c1-49ec-9a74-a43b8f070aee None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.761406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36904b6-10c1-49ec-9a74-a43b8f070aee None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.761685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36904b6-10c1-49ec-9a74-a43b8f070aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.791474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 845/1676] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:53.799436 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.799950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.800551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.802984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a36904b6-10c1-49ec-9a74-a43b8f070aee None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:53.804460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a36904b6-10c1-49ec-9a74-a43b8f070aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.824090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 832/1677] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:53.831930 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.832215 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.832507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.833202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:53.840082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.863381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 846/1678] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:11:53.867975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:53.868084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:53.869274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:53.886551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 833/1679] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:11:53.888697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa37272-41ed-452f-ac0b-489ca7cc49fa None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.890321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:53.904200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.904921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.905324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.905606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.906368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:53.907089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.907203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce97059-a8a2-4d8b-99f9-9399b8a4e21e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.911628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:53.921832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.922682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.922787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.923023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.923786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:53.924100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.925795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:53.950244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 847/1680] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:11:53.955200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 834/1681] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:53.955356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:53.956744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:53.974933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d81df-eeaf-4878-a321-7503615c6be4 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.978143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf579f-91bd-48a6-a997-794013f55068 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:53.988123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.988982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.989709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.989709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.989885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:53.990680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.990813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:53.990813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:53.990813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:53.991519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:53.992267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:53.997298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.053927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 835/1682] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:53 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:11:54.056004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.063300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 848/1683] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:53 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:54.065025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.191460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c174-5a38-441b-af3c-28754bf19c29 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.292716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b158-b074-4fb3-a3dc-db2b5907acda admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.298719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.299433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.299703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.299978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.300689 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.302662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.331065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7babf9-7b2d-42dc-890d-c64997c12a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.331778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7babf9-7b2d-42dc-890d-c64997c12a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.332019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:54.332145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7babf9-7b2d-42dc-890d-c64997c12a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.332322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7babf9-7b2d-42dc-890d-c64997c12a8d admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.333354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7babf9-7b2d-42dc-890d-c64997c12a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.335118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7babf9-7b2d-42dc-890d-c64997c12a8d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.367755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 849/1684] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:54 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:11:54.367755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.369649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:54.386546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 836/1685] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:54 2022] POST /identity/v3/users => generated 284 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:11:54.386546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa9a4-752e-42d4-91ed-2445229ce13c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.387068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa9a4-752e-42d4-91ed-2445229ce13c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.388456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa9a4-752e-42d4-91ed-2445229ce13c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.391248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 837/1686] 10.222.0.20 () {54 vars in 960 bytes} [Tue Jun 7 13:11:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:11:54.392306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa9a4-752e-42d4-91ed-2445229ce13c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.399030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279698c6-8bc0-4a1b-9304-c6dec73cded6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.422652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa9a4-752e-42d4-91ed-2445229ce13c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.426208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.428608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.429088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.429502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] PATH_INFO: `/v3/projects/f2715d1984e243a6bb22cbdae4a3f1c7` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.432248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2715d1984e243a6bb22cbdae4a3f1c7)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.434361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.438516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.439308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.439609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.439866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.449890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.451623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.485103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 838/1687] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:54.486133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.515306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc708b4-ecaa-48ea-a6e9-3e7d9436aea3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.541801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf77f-9eda-4132-bd2f-b1ef93d285a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.542508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf77f-9eda-4132-bd2f-b1ef93d285a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.542795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf77f-9eda-4132-bd2f-b1ef93d285a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.543073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf77f-9eda-4132-bd2f-b1ef93d285a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.543827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bf77f-9eda-4132-bd2f-b1ef93d285a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.545523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bf77f-9eda-4132-bd2f-b1ef93d285a3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.589974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 839/1688] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:54.593752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.594043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.594531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.602262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2715d1984e243a6bb22cbdae4a3f1c7', 'request_id': 'req-5a399640-b357-444b-9d4a-72a25bbe706d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:54.625672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2715d1984e243a6bb22cbdae4a3f1c7', 'request_id': 'req-5a399640-b357-444b-9d4a-72a25bbe706d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:54.634619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2715d1984e243a6bb22cbdae4a3f1c7', 'request_id': 'req-5a399640-b357-444b-9d4a-72a25bbe706d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:54.650932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:54.653194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:54.660647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] The token cache is being invalidate because project f2715d1984e243a6bb22cbdae4a3f1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:54.660949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:54.661658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:54.664299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 850/1689] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:54 2022] DELETE /identity/v3/projects/f2715d1984e243a6bb22cbdae4a3f1c7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:54.665225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.669591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:54.677908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:54.810782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399640-b357-444b-9d4a-72a25bbe706d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.830694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2318f81-1699-45fd-a8cd-deb11b7d24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.831417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318f81-1699-45fd-a8cd-deb11b7d24b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.831704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318f81-1699-45fd-a8cd-deb11b7d24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.831979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318f81-1699-45fd-a8cd-deb11b7d24b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.832739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2318f81-1699-45fd-a8cd-deb11b7d24b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.834443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2318f81-1699-45fd-a8cd-deb11b7d24b3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.847216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 840/1690] 10.222.0.20 () {58 vars in 1057 bytes} [Tue Jun 7 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:54.848413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.849998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:54.851873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 851/1691] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:54.853388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.853683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.853966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.868167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51d25-9c32-4cb1-9c22-f4f8db5e882a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.874354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.875060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.875340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.875676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.876994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.879021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.894411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 841/1692] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:54.895258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.895466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:54.904011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:54.914753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301d164-a40a-47c7-ab65-87904630f3f7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.922416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 852/1693] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:54.923531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.923984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.924642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.924971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.925313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.928225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:54.943010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3ea40-2fa5-4a89-a13e-5bef1870a1ce None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:54.951206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.953118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:54.957485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ade49-0030-4bf0-9951-431891559e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:54.958417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ade49-0030-4bf0-9951-431891559e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:54.958704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ade49-0030-4bf0-9951-431891559e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:54.958980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ade49-0030-4bf0-9951-431891559e93 admin admin] PATH_INFO: `/v3/projects/f6cac04257d64ca4991b38d5d90ff1e6/users/db1129cd3fbb45129e3de45385e5aa24/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:54.986587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 842/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:54.988357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:54.989511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ade49-0030-4bf0-9951-431891559e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cac04257d64ca4991b38d5d90ff1e6, user_id=db1129cd3fbb45129e3de45385e5aa24, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:54.992203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ade49-0030-4bf0-9951-431891559e93 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:55.018372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e2bb-e04e-4997-b35d-fc209155e2c6 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:55.022993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 853/1695] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:54 2022] PUT /identity/v3/projects/f6cac04257d64ca4991b38d5d90ff1e6/users/db1129cd3fbb45129e3de45385e5aa24/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:55.024415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048b61-8f07-456a-b8d5-2d8d8daa2dfc None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.024710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048b61-8f07-456a-b8d5-2d8d8daa2dfc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.024991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048b61-8f07-456a-b8d5-2d8d8daa2dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.064035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-59048b61-8f07-456a-b8d5-2d8d8daa2dfc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:55.069496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-59048b61-8f07-456a-b8d5-2d8d8daa2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:55.154479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:55.164650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:55.167653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.169266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.170243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] PATH_INFO: `/v3/projects/2afcbb27a3564309b947992c9ced7466/users/0a26ef1de3d94074813e1dee30924c86/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.202317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 854/1696] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:55.206107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.208210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.208614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.244260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afcbb27a3564309b947992c9ced7466, user_id=0a26ef1de3d94074813e1dee30924c86, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:55.248475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:55.264563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] MFA Rules not processed for user `db1129cd3fbb45129e3de45385e5aa24`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:55.266245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:55.284174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 843/1697] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:54 2022] PUT /identity/v3/projects/2afcbb27a3564309b947992c9ced7466/users/0a26ef1de3d94074813e1dee30924c86/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:55.286758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:55.291108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:55.468857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 855/1698] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:55.470199 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:55.518619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7798-6aec-4b66-913f-17aea3ccdff6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:55.525878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:55.527048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.527686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.528887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] PATH_INFO: `/v3/projects/51f8af298f254243bd24dcde1446cc53` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.530726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f8af298f254243bd24dcde1446cc53)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:55.534471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:55.551472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:55.678925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f8af298f254243bd24dcde1446cc53', 'request_id': 'req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:55.709660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f8af298f254243bd24dcde1446cc53', 'request_id': 'req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:55.710031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3112a1-845f-4c29-acc0-4e785f37258d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:55.717909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f8af298f254243bd24dcde1446cc53', 'request_id': 'req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:55.748843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] The token cache is being invalidate because project 51f8af298f254243bd24dcde1446cc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:55.752046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:55.754579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7c2b03e6-98cf-4c17-b68f-73c02f56d5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:55.763982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 844/1699] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:55 2022] DELETE /identity/v3/projects/51f8af298f254243bd24dcde1446cc53 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:55.763982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.763982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.763982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.824127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] MFA Rules not processed for user `0a26ef1de3d94074813e1dee30924c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:55.824534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:55.891213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:55.892532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.893057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.893597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.894824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:11:55.895320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:55.899376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:55.917975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 845/1700] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:55.918959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:55.920584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:55.928870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 856/1701] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:11:55.930099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:55.935739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:55.957258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9d2f1-4ab6-41ec-92ee-be63a7a2bbd4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:55.972385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:55.973617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.973898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.974174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.975785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf0614-a5fc-45b8-b211-1155ffaa47f7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:55.977368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:55.982390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:55.987734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:55.990041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:55.990327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:55.992197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] PATH_INFO: `/v3/users/6c195fdb8a534a70a2b46f08a6b9b94e` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:55.997060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c195fdb8a534a70a2b46f08a6b9b94e)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:56.004298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:56.037182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:56.088697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 846/1702] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:55 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:56.094013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:56.097244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:56.176952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c195fdb8a534a70a2b46f08a6b9b94e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:56.178836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c195fdb8a534a70a2b46f08a6b9b94e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:56.186411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c195fdb8a534a70a2b46f08a6b9b94e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:56.206342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c195fdb8a534a70a2b46f08a6b9b94e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:56.254463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c195fdb8a534a70a2b46f08a6b9b94e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:56.302246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 857/1703] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:11:55 2022] DELETE /identity/v3/users/6c195fdb8a534a70a2b46f08a6b9b94e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:56.307504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:56.319598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:56.367470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604ebe0-1eff-4389-8bd8-2adf6a9c7c87 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:56.410890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:56.520880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bf9d-6df6-418e-9978-26fd3fe422bf admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:56.536222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:56.537160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:56.537604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:56.539811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:56.540696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:56.544346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:56.556009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:56.556796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:56.557109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:56.557657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:56.559356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:56.565136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:56.654614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 847/1704] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:56 2022] POST /identity/v3/projects => generated 369 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:56.654614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:56.659182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 858/1705] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:56 2022] POST /identity/v3/projects => generated 383 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:56.660447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:56.661693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:56.674871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:56.784150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9454f-cb2e-4487-8f2d-4905f27a10c6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:56.791768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:56.792667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:56.793199 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:56.794144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:56.795528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:56.798439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:56.872107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:56.885328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 859/1706] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:56 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:56.886693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:56.901725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4e474-a1d7-459f-992b-06e6ab1bea9a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:56.903551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd991f-4b02-415b-b540-0b7e6e231f8f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:56.930851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:56.935466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:56.936070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:56.936490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:56.940108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:56.941287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:56.941690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:56.941994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:56.942366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:56.944504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:56.948173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:56.951914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.025846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 848/1707] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:56 2022] POST /identity/v3/users => generated 295 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:57.027998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.028397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 860/1708] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:11:56 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:57.033377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.066899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7edf5b-3380-485e-8978-06eff47a69c8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.071550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1a95a-20b9-4b82-a938-745edc762b9b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.085878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.086783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.087705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.088086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.088536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.095851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.096278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.096729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.097415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.100202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.100535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.106015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.147883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 849/1709] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:57.151369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.152168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 861/1710] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:57.157987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.189131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c26ef-17f1-4750-bb46-c0a5af3db234 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.202241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa5662-29a4-490a-9cdd-fcb923e305f6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.207820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.209863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.211400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.211400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.212418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.220710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.224298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.224647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.225228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.226872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] PATH_INFO: `/v3/projects/f488874646414cc1b6192c97dfa9c449/users/fde7019918c5455ea344ed5d82077fc3/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.290858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 850/1711] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:57.292484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.309610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f488874646414cc1b6192c97dfa9c449, user_id=fde7019918c5455ea344ed5d82077fc3, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.325109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.337967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b64a-36d9-4156-81a7-4f33d14f3135 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.380340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.382884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.383414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.384115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] PATH_INFO: `/v3/projects/0f812c84e87c4cc0b50204d3588e598d/users/85869e3f3949483a818acfe4010ecd4a/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.393381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 862/1712] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:57 2022] PUT /identity/v3/projects/f488874646414cc1b6192c97dfa9c449/users/fde7019918c5455ea344ed5d82077fc3/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:57.396255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.468135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f812c84e87c4cc0b50204d3588e598d, user_id=85869e3f3949483a818acfe4010ecd4a, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.480782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.530909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 851/1713] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:57 2022] PUT /identity/v3/projects/0f812c84e87c4cc0b50204d3588e598d/users/85869e3f3949483a818acfe4010ecd4a/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:57.533451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.690123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76136a4c-69e5-48cf-a384-3e49d2a585d1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.747406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:57.814882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2560b8-bdcf-4fe1-8422-e92f846bde11 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.854843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.859350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.859699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.860292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.861274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.867616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.906111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 852/1714] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:57.909174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:57.943624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e369-a249-4394-9920-6538e873fb5c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:57.969407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.970167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.970457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.970733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.974969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:57.981838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:57.992233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:57.996443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:57.996978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:57.997383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:57.998424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:58.000134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:58.026526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 863/1715] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 632 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:58.027573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:58.035770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:58.039730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 853/1716] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:11:58.043271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:58.065738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963090b9-6a71-4166-ba75-ccd06bf5c7e9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:58.082726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21672b-654c-4b9b-9360-e2087696f2d2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:58.092809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:58.093955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.094396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.094840 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] PATH_INFO: `/v3/projects/f488874646414cc1b6192c97dfa9c449/users/fde7019918c5455ea344ed5d82077fc3/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.102279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f488874646414cc1b6192c97dfa9c449, user_id=fde7019918c5455ea344ed5d82077fc3, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:58.105409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:58.105982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:58.106489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.106743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.107020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] PATH_INFO: `/v3/projects/a2734dc7a059428586d827c52c3f0f05` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.111333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2734dc7a059428586d827c52c3f0f05)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:58.119359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:58.136497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 854/1717] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:58 2022] PUT /identity/v3/projects/f488874646414cc1b6192c97dfa9c449/users/fde7019918c5455ea344ed5d82077fc3/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:58.137800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:58.285217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:58.299131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2734dc7a059428586d827c52c3f0f05', 'request_id': 'req-0e770550-8da6-4817-a475-0550ca8e1865'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:58.327980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2734dc7a059428586d827c52c3f0f05', 'request_id': 'req-0e770550-8da6-4817-a475-0550ca8e1865'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:58.335801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c876969-ba02-4339-b895-6546053b0584 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:58.353972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2734dc7a059428586d827c52c3f0f05', 'request_id': 'req-0e770550-8da6-4817-a475-0550ca8e1865'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:58.380168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] The token cache is being invalidate because project a2734dc7a059428586d827c52c3f0f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:11:58.381483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:58.383192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:11:58.391818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 864/1718] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:11:58 2022] DELETE /identity/v3/projects/a2734dc7a059428586d827c52c3f0f05 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:58.392788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:58.395112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:58.536064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36280-1239-4520-8b27-25f6eff558bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:58.537007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36280-1239-4520-8b27-25f6eff558bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.537314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36280-1239-4520-8b27-25f6eff558bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.537876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36280-1239-4520-8b27-25f6eff558bf admin admin] PATH_INFO: `/v3/projects/523c769801c747d2bfd5c835c7248ce6/users/f2da4842a1fd472fb6e1575c009de4f5/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.575279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e770550-8da6-4817-a475-0550ca8e1865 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:58.585699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e36280-1239-4520-8b27-25f6eff558bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=523c769801c747d2bfd5c835c7248ce6, user_id=f2da4842a1fd472fb6e1575c009de4f5, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:58.594885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc86c64-d3b6-4420-b3da-2ee5f5f04c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:58.595574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e36280-1239-4520-8b27-25f6eff558bf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:58.596248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc86c64-d3b6-4420-b3da-2ee5f5f04c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.596669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc86c64-d3b6-4420-b3da-2ee5f5f04c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.597153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc86c64-d3b6-4420-b3da-2ee5f5f04c85 admin admin] PATH_INFO: `/v3/projects/0f812c84e87c4cc0b50204d3588e598d/users/85869e3f3949483a818acfe4010ecd4a/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.599350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc86c64-d3b6-4420-b3da-2ee5f5f04c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f812c84e87c4cc0b50204d3588e598d, user_id=85869e3f3949483a818acfe4010ecd4a, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:58.602268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc86c64-d3b6-4420-b3da-2ee5f5f04c85 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:58.630623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 855/1719] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:58 2022] PUT /identity/v3/projects/523c769801c747d2bfd5c835c7248ce6/users/f2da4842a1fd472fb6e1575c009de4f5/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:58.644622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f9be-5d0d-46fb-97db-e520228dbf6c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.645134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f9be-5d0d-46fb-97db-e520228dbf6c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.645285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 865/1720] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:11:58 2022] PUT /identity/v3/projects/0f812c84e87c4cc0b50204d3588e598d/users/85869e3f3949483a818acfe4010ecd4a/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:11:58.646791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db12750-4e6a-4a02-99bc-350ca5f08c74 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.647228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db12750-4e6a-4a02-99bc-350ca5f08c74 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.647638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db12750-4e6a-4a02-99bc-350ca5f08c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.654845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f9be-5d0d-46fb-97db-e520228dbf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.712238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2db12750-4e6a-4a02-99bc-350ca5f08c74 None None] MFA Rules not processed for user `025ca1d10d5e49e984c7fd4e0b425f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:58.714151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2db12750-4e6a-4a02-99bc-350ca5f08c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:58.769101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0b48f9be-5d0d-46fb-97db-e520228dbf6c None None] MFA Rules not processed for user `fde7019918c5455ea344ed5d82077fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:58.772377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0b48f9be-5d0d-46fb-97db-e520228dbf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:58.911067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:58.945308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 866/1721] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:58.946690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd10e-487b-4a8a-900b-af7f06d5b184 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:58.947000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd10e-487b-4a8a-900b-af7f06d5b184 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:58.947259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd10e-487b-4a8a-900b-af7f06d5b184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:58.995527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9a1fd10e-487b-4a8a-900b-af7f06d5b184 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:58.997067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9a1fd10e-487b-4a8a-900b-af7f06d5b184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.059813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 856/1722] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.061251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7668c-9656-4fe9-912e-f93fec07670b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.061542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7668c-9656-4fe9-912e-f93fec07670b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.061818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7668c-9656-4fe9-912e-f93fec07670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.116295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:59.136485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f7b7668c-9656-4fe9-912e-f93fec07670b None None] MFA Rules not processed for user `f2da4842a1fd472fb6e1575c009de4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:59.137753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 867/1723] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.137858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f7b7668c-9656-4fe9-912e-f93fec07670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.139372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c8110-a394-474b-b91d-bdf5f4289f1c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.139984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c8110-a394-474b-b91d-bdf5f4289f1c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.140387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c8110-a394-474b-b91d-bdf5f4289f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.218284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-138c8110-a394-474b-b91d-bdf5f4289f1c None None] MFA Rules not processed for user `85869e3f3949483a818acfe4010ecd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:59.219837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-138c8110-a394-474b-b91d-bdf5f4289f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.321808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 857/1724] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.329257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.330187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.331606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.365748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] MFA Rules not processed for user `025ca1d10d5e49e984c7fd4e0b425f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:59.370882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.392015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 858/1725] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.393501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:59.397892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.445360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 868/1726] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.445360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a563-7cad-4575-85d0-83b6af59af3a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.445360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a563-7cad-4575-85d0-83b6af59af3a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.445360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a563-7cad-4575-85d0-83b6af59af3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.506242 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0a83a563-7cad-4575-85d0-83b6af59af3a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:59.507742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0a83a563-7cad-4575-85d0-83b6af59af3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.538889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 869/1727] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.538889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.538889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.538889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.579377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec213d-5ccd-4911-a3c3-1962509f65c3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:59.583830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:11:59.585051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:59.586774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.587076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.587355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.587645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.589618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.720118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 870/1728] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:11:59.721777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:59.730448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:59.731990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:59.735980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.756895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 859/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:59.758054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:59.759466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.795929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:59.796108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0983ff-5260-42db-af32-3cdf6fb526af None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:59.803516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:59.804566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.805583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.806068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.807037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:11:59.810268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:11:59.861832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 871/1730] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:11:59 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:11:59.863811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:11:59.866004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:11:59.960409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed7b1a-5bb5-484b-92d9-71d5896fc28b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:11:59.972040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:11:59.973481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:11:59.973963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:11:59.975466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:11:59.979644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97465fd-90df-4d45-a046-e1e15205929f service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:00.027830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:00.101474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:00.104083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:00.132468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 872/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:00.132774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:00.133600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:00.133977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:00.135040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:00.135716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:00.278567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:00.292631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:00.347103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 860/1732] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:00.351225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:00.358391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01d85-be5c-4e17-b959-7b48f724e21a service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:00.372354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:00.374284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:00.380778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:00.383377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:00.386422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:00.386988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:00.394097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d619-80bf-4d90-a472-75d9b71abac5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:00.408997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d04c41-0dd9-4a2b-828b-c96c0a2912cc service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:00.426193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:00.427280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:00.427694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:00.428377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:00.429484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:00.435276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:00.435989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 873/1733] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:00.438120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:00.438638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:00.439052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:00.528546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 861/1734] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:00 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:00.529579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:00.537656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:00.559243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] MFA Rules not processed for user `8b341180925b454094d9bf5e6f5b3eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:00.559243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:00.689378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:00.869596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 874/1735] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:00.872063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:00.892252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216290-2754-4935-b3d2-7ffcfa041ce8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:00.913395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:00.918806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:00.919314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:00.920552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:00.922716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135e553-e9b0-4912-afe7-42624c687f29 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:00.942590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:00.943432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:00.943808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:00.945714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:00.946969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:00.956552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:01.046709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 875/1736] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:00 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:01.046709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:01.100943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:01.128383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:01.134061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:01.165692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 862/1737] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:12:01.184197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dab3a4-ed7c-4f4c-8820-419939d4db70 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:01.185205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:01.220105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:01.237265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:01.237964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:01.238245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:01.238603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:01.239356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:01.254451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a6d81-8c2c-4410-9466-67db01728e6d service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:01.257676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:01.306551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 876/1738] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:01.307522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:01.334540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d2149-8809-4f53-81f1-0035f6df4289 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:01.373546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434de453-f397-4b86-9880-281ed6173277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:01.374286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434de453-f397-4b86-9880-281ed6173277 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:01.374569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434de453-f397-4b86-9880-281ed6173277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:01.374857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434de453-f397-4b86-9880-281ed6173277 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:01.375980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434de453-f397-4b86-9880-281ed6173277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:01.378342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434de453-f397-4b86-9880-281ed6173277 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:01.469606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:01.471219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:01.471524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:01.472996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:01.490183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 877/1739] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:01 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:01.504549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:01.504902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:01.505207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:01.618421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] MFA Rules not processed for user `e1e6349a50ec4554b27b94b3f0f2dcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:01.619642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:01.716487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:01.719402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:01.758157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 863/1740] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:01.761327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:01.773075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:01.801064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceb82-eeec-4ae9-b665-480b97e41073 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:01.817962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:01.818906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:01.819193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:01.823770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] PATH_INFO: `/v3/projects/a70f4700943f470b9afac510ff3b0498/users/6c9e421db08e4235b8b808d652e850d3/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:01.872394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 878/1741] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:01.873283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:01.885647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70f4700943f470b9afac510ff3b0498, user_id=6c9e421db08e4235b8b808d652e850d3, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:01.892379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:01.925217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563ed78-8b51-4bd4-a13f-dd7804d4f878 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:01.947798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 864/1742] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:01 2022] PUT /identity/v3/projects/a70f4700943f470b9afac510ff3b0498/users/6c9e421db08e4235b8b808d652e850d3/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:01.952520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:01.956338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:01.957930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:01.958232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:01.960119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:01.960929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:01.962606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:02.009635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 879/1743] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:02.015740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:02.075602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeba81-d017-460d-a9de-05326d09b3bc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:02.220668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698cab7-040f-477b-a4ac-743eee7bf618 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:02.240799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9094fe2-60d3-409d-a20c-8e8795588070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:02.241788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094fe2-60d3-409d-a20c-8e8795588070 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.242237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094fe2-60d3-409d-a20c-8e8795588070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.242673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094fe2-60d3-409d-a20c-8e8795588070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.243588 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9094fe2-60d3-409d-a20c-8e8795588070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:02.247938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9094fe2-60d3-409d-a20c-8e8795588070 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:02.307980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 865/1744] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:02.308364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c859945-422f-447f-938e-3e3c483b4d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:02.320983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc8a7b-4e86-454c-978e-271b22147188 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.322087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc8a7b-4e86-454c-978e-271b22147188 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.322421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc8a7b-4e86-454c-978e-271b22147188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.353616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859945-422f-447f-938e-3e3c483b4d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.354886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859945-422f-447f-938e-3e3c483b4d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.360379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859945-422f-447f-938e-3e3c483b4d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.368399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859945-422f-447f-938e-3e3c483b4d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:02.374238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859945-422f-447f-938e-3e3c483b4d26 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:02.405821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-08dc8a7b-4e86-454c-978e-271b22147188 None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:02.405821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-08dc8a7b-4e86-454c-978e-271b22147188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:02.451315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 880/1745] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:02.454661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8640a-ab39-40a4-9988-7b2a255fddaf None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.458179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8640a-ab39-40a4-9988-7b2a255fddaf None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.458618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8640a-ab39-40a4-9988-7b2a255fddaf None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.463293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 881/1746] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jun 7 13:12:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:12:02.464660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8640a-ab39-40a4-9988-7b2a255fddaf None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:02.491939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:02.502742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8640a-ab39-40a4-9988-7b2a255fddaf None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:02.533178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:02.535604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.538816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.539348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] PATH_INFO: `/v3/projects/a70f4700943f470b9afac510ff3b0498/users/6c9e421db08e4235b8b808d652e850d3/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.548708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70f4700943f470b9afac510ff3b0498, user_id=6c9e421db08e4235b8b808d652e850d3, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:02.552880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:02.605136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 882/1747] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:02 2022] PUT /identity/v3/projects/a70f4700943f470b9afac510ff3b0498/users/6c9e421db08e4235b8b808d652e850d3/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:02.605136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:02.636980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 866/1748] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Jun 7 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:02.640356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2680a4-4a22-4dc0-978d-ea9a551f13b4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.642713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2680a4-4a22-4dc0-978d-ea9a551f13b4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.644977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2680a4-4a22-4dc0-978d-ea9a551f13b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.672925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2e2680a4-4a22-4dc0-978d-ea9a551f13b4 None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:02.674498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e2680a4-4a22-4dc0-978d-ea9a551f13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:02.870946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b655a-fe6a-4d38-8850-73c458610f08 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:02.896687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:02.898721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.899176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.899616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] PATH_INFO: `/v3/projects/5b5c59f4b56a48689ee6f01bd7e21b65/users/f2ce5ec8e5af4465b515dbd13b0a21eb/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.934093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 867/1749] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:02.936234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae6cf-ec54-471f-8550-2eaf9f9614b5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:02.936674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae6cf-ec54-471f-8550-2eaf9f9614b5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:02.939977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae6cf-ec54-471f-8550-2eaf9f9614b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:02.952464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5c59f4b56a48689ee6f01bd7e21b65, user_id=f2ce5ec8e5af4465b515dbd13b0a21eb, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:02.955588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:03.001207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 883/1750] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:02 2022] PUT /identity/v3/projects/5b5c59f4b56a48689ee6f01bd7e21b65/users/f2ce5ec8e5af4465b515dbd13b0a21eb/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:03.002521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:03.014416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:03.042436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-958ae6cf-ec54-471f-8550-2eaf9f9614b5 None None] MFA Rules not processed for user `6c9e421db08e4235b8b808d652e850d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:03.045684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-958ae6cf-ec54-471f-8550-2eaf9f9614b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:03.152539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:03.198326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc404635-246a-4794-9aed-0322cd540bb9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:03.209596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:03.210233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:03.212156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:03.212455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:03.231521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:03.233298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:03.260095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 884/1751] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:03.260999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:03.286487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81010b-1d50-42bd-978b-5c398d7e2da1 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:03.306980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:03.307667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:03.308106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:03.308397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:03.334238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:03.334879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 868/1752] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:03.338124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:03.338882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:03.339768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:03.340263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:03.361754 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 885/1753] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:03.364188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:03.408960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] MFA Rules not processed for user `f2ce5ec8e5af4465b515dbd13b0a21eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:03.413210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:03.543434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:03.562904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010d625-986d-4190-b28e-20a5e666250c service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:03.591547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:03.595763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:03.596326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:03.596705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:03.626026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 869/1754] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:03.633953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:03.811561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:03.819802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:03.856288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 886/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:03.860047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:03.881062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d1dfa-d598-4904-b041-9a4d99413605 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:03.895470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:03.896796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:03.897422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:03.897949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:03.923922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:03.925591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:03.962076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 870/1756] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:03.965379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:04.060550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e266fad-2838-4bfb-8a23-391b89341435 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:04.071730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:04.072426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.075603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.075876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:04.076618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:04.082563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:04.136518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:04.161218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 887/1757] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:03 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:04.165725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:04.172267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c5b1b-aa2d-4fff-a9ad-8b4dd5c944f2 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:04.321341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293230f-580f-4422-a85b-a8935ef35d97 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:04.327531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:04.328595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.328985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.329292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] PATH_INFO: `/v3/users/0a26ef1de3d94074813e1dee30924c86` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:04.331238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f3fb-c312-4113-96c4-9ef8270fcf3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:04.331909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f3fb-c312-4113-96c4-9ef8270fcf3f service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.332187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f3fb-c312-4113-96c4-9ef8270fcf3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.332455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f3fb-c312-4113-96c4-9ef8270fcf3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:04.333826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a26ef1de3d94074813e1dee30924c86)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:04.336305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:04.444849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:04.457695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a26ef1de3d94074813e1dee30924c86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:04.460269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a26ef1de3d94074813e1dee30924c86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:04.461833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a26ef1de3d94074813e1dee30924c86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:04.489881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a26ef1de3d94074813e1dee30924c86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:04.516424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a26ef1de3d94074813e1dee30924c86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:04.520994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084f3fb-c312-4113-96c4-9ef8270fcf3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:04.523599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084f3fb-c312-4113-96c4-9ef8270fcf3f service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:04.547053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 871/1758] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:03 2022] DELETE /identity/v3/users/0a26ef1de3d94074813e1dee30924c86 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:04.547944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:04.550634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:04.589056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 888/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:04.593831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.595079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.595888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:04.673646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:04.676255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:04.784885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93032f0-02a9-4e7b-b33a-d860dd6b8ec4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:04.806396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:04.807112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.807395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.807668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:04.808385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:04.810386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:04.874061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 872/1760] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:04 2022] POST /identity/v3/users => generated 299 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:04.878410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:04.894074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ade31-7e35-4854-8369-912fe42671dd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:04.907650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:04.908668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.908916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.909253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:04.910053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:04.911807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:04.913519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:04.934713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 889/1761] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:04.935536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 873/1762] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:04.945519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:04.963978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0dadf-751d-4bb6-922b-a4f8ac6488a2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:04.979549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:04.980846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:04.981254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:04.981695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] PATH_INFO: `/v3/projects/2dde2f9516ec4d84b5d60e8a31451eb4/users/a989c26e517340618eb65c0f6c76aeff/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:05.027137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dde2f9516ec4d84b5d60e8a31451eb4, user_id=a989c26e517340618eb65c0f6c76aeff, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:05.034644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:05.078371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 890/1763] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:04 2022] PUT /identity/v3/projects/2dde2f9516ec4d84b5d60e8a31451eb4/users/a989c26e517340618eb65c0f6c76aeff/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:05.082368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:05.098316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f86696-e694-4dec-8d45-5e433a00237c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:05.119709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:05.121499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:05.302385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:05.303088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:05.303371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:05.303649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:05.304805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:05.308140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:05.310641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e544299-cfe7-4903-925f-addc4fdfe9a5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:05.318291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3732c4b-b5d9-40dc-85a9-087af00c25f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:05.318936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3732c4b-b5d9-40dc-85a9-087af00c25f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:05.319217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3732c4b-b5d9-40dc-85a9-087af00c25f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:05.323897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3732c4b-b5d9-40dc-85a9-087af00c25f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:05.347025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 874/1764] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:05.349831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:05.357227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3732c4b-b5d9-40dc-85a9-087af00c25f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:05.358870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3732c4b-b5d9-40dc-85a9-087af00c25f4 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:05.386045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede7fae-c8e2-4dfb-a550-f088af3361ca admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:05.406722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf8a53-c41e-4b76-829d-8fc6478a32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:05.407665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf8a53-c41e-4b76-829d-8fc6478a32a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:05.408230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 891/1765] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:05.409868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf8a53-c41e-4b76-829d-8fc6478a32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:05.410175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf8a53-c41e-4b76-829d-8fc6478a32a4 admin admin] PATH_INFO: `/v3/projects/2dde2f9516ec4d84b5d60e8a31451eb4/users/a989c26e517340618eb65c0f6c76aeff/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:05.416302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf8a53-c41e-4b76-829d-8fc6478a32a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dde2f9516ec4d84b5d60e8a31451eb4, user_id=a989c26e517340618eb65c0f6c76aeff, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:05.419233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf8a53-c41e-4b76-829d-8fc6478a32a4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:05.450044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 875/1766] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:05 2022] PUT /identity/v3/projects/2dde2f9516ec4d84b5d60e8a31451eb4/users/a989c26e517340618eb65c0f6c76aeff/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:05.462391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:05.463106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:05.463485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:05.529310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] MFA Rules not processed for user `a989c26e517340618eb65c0f6c76aeff`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:05.531599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:05.670014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:05.678456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:05.678768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:05.679064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:05.748757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] MFA Rules not processed for user `025ca1d10d5e49e984c7fd4e0b425f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:05.754007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:05.793055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 892/1767] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:05.807254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:05.809737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:05.967834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 876/1768] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:06.003561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5d8a-930e-4203-8030-f8f9d39baef6 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:06.015381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15ce9-8a33-4d1b-924e-19a28281c113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:06.016139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15ce9-8a33-4d1b-924e-19a28281c113 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:06.016420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15ce9-8a33-4d1b-924e-19a28281c113 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:06.016707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15ce9-8a33-4d1b-924e-19a28281c113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:06.080856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15ce9-8a33-4d1b-924e-19a28281c113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:06.099656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15ce9-8a33-4d1b-924e-19a28281c113 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:06.137203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 893/1769] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:06.373199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:06.667711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4479e-cf54-4581-a381-da0c60a0f47c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:06.687292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:06.689927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:06.692900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:06.693980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] PATH_INFO: `/v3/users/f2ce5ec8e5af4465b515dbd13b0a21eb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:06.696539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ce5ec8e5af4465b515dbd13b0a21eb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:06.698998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:06.779034 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:06.817631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003a31-f303-4e54-a7e1-6f0f2fa4caab None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:06.818092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003a31-f303-4e54-a7e1-6f0f2fa4caab None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:06.818751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003a31-f303-4e54-a7e1-6f0f2fa4caab None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:06.820123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 894/1770] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:12:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 13:12:06.852378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ce5ec8e5af4465b515dbd13b0a21eb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:06.853201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ce5ec8e5af4465b515dbd13b0a21eb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:06.854993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ce5ec8e5af4465b515dbd13b0a21eb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:06.862586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b1333-5016-41df-82a8-d18711516e26 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:06.862848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b1333-5016-41df-82a8-d18711516e26 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:06.863137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b1333-5016-41df-82a8-d18711516e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:06.875729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ce5ec8e5af4465b515dbd13b0a21eb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:06.907428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-149b1333-5016-41df-82a8-d18711516e26 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:06.908742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e10f50ea-04b1-467d-9af2-56599d28ee6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ce5ec8e5af4465b515dbd13b0a21eb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:06.908886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-149b1333-5016-41df-82a8-d18711516e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:06.972263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 877/1771] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:06 2022] DELETE /identity/v3/users/f2ce5ec8e5af4465b515dbd13b0a21eb => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:06.974340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:06.975096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:06.975467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:07.088517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:07.090407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:07.103870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 895/1772] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:07.280476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 878/1773] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:07.337650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b1333-5016-41df-82a8-d18711516e26 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:07.339405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-149b1333-5016-41df-82a8-d18711516e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:07.370661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:07.372092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:07.376743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b1333-5016-41df-82a8-d18711516e26 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:07.534295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:07.535004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085c076-9d24-4b4c-bd24-4d8ca95546dd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:07.536663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:07.537375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:07.538079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:07.542987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:07.543733 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:07.544096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:07.544285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:07.554953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:07.557456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:07.566441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:07.567902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:07.575296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 896/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:07.582414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 879/1775] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:08.229973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:08.231668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:08.246329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:08.251465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1bbe9-1c40-4279-b36f-97c1d309a4b2 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:08.257701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:08.259051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:08.259525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:08.260097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] PATH_INFO: `/v3/projects/5b5c59f4b56a48689ee6f01bd7e21b65` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:08.261638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5c59f4b56a48689ee6f01bd7e21b65)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:08.264019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:08.327824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5c59f4b56a48689ee6f01bd7e21b65', 'request_id': 'req-f90bbacd-0bc2-4902-ab0f-49a84064f009'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.341584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5c59f4b56a48689ee6f01bd7e21b65', 'request_id': 'req-f90bbacd-0bc2-4902-ab0f-49a84064f009'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.349130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5c59f4b56a48689ee6f01bd7e21b65', 'request_id': 'req-f90bbacd-0bc2-4902-ab0f-49a84064f009'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.365731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] The token cache is being invalidate because project 5b5c59f4b56a48689ee6f01bd7e21b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:08.366189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.366979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.369112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 897/1776] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:08 2022] DELETE /identity/v3/projects/5b5c59f4b56a48689ee6f01bd7e21b65 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:08.373314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:08.395325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:08.397720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:08.399423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ab64-f3df-4c12-bee4-c1ea4fb7bb21 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:08.499450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:08.520568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbacd-0bc2-4902-ab0f-49a84064f009 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:08.524842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:08.525866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:08.526218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:08.526845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] PATH_INFO: `/v3/users/a989c26e517340618eb65c0f6c76aeff` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:08.528281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a989c26e517340618eb65c0f6c76aeff)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:08.529621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:08.530412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:08.530691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:08.531023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] PATH_INFO: `/v3/projects/2afcbb27a3564309b947992c9ced7466` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:08.531634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:08.532713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afcbb27a3564309b947992c9ced7466)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:08.540959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:08.643950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a989c26e517340618eb65c0f6c76aeff'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.645234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a989c26e517340618eb65c0f6c76aeff'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.645751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a989c26e517340618eb65c0f6c76aeff'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.660808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a989c26e517340618eb65c0f6c76aeff'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.673309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afcbb27a3564309b947992c9ced7466', 'request_id': 'req-7436fcab-dccf-4a2f-91f0-a718f6ccb547'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.681646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a989c26e517340618eb65c0f6c76aeff'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.690354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afcbb27a3564309b947992c9ced7466', 'request_id': 'req-7436fcab-dccf-4a2f-91f0-a718f6ccb547'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.703177 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afcbb27a3564309b947992c9ced7466', 'request_id': 'req-7436fcab-dccf-4a2f-91f0-a718f6ccb547'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.712775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 880/1777] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:08 2022] DELETE /identity/v3/users/a989c26e517340618eb65c0f6c76aeff => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:08.763541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] The token cache is being invalidate because project 2afcbb27a3564309b947992c9ced7466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:08.764388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.765232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7436fcab-dccf-4a2f-91f0-a718f6ccb547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:08.771098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 898/1778] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:08 2022] DELETE /identity/v3/projects/2afcbb27a3564309b947992c9ced7466 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:08.772075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:08.773813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:09.095186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166f088-0044-48b2-8b5e-5829083febd6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:09.131507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:09.132962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:09.133389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:09.133719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] PATH_INFO: `/v3/users/85869e3f3949483a818acfe4010ecd4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:09.136163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=85869e3f3949483a818acfe4010ecd4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:09.138574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:09.191823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:09.192352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:09.192778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:09.217968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] MFA Rules not processed for user `8b341180925b454094d9bf5e6f5b3eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:09.220099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:09.247045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:09.282613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85869e3f3949483a818acfe4010ecd4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:09.285150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85869e3f3949483a818acfe4010ecd4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:09.287225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85869e3f3949483a818acfe4010ecd4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:09.313897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85869e3f3949483a818acfe4010ecd4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:09.330228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:09.342997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85869e3f3949483a818acfe4010ecd4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:09.374917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 899/1779] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:09.395817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 881/1780] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:08 2022] DELETE /identity/v3/users/85869e3f3949483a818acfe4010ecd4a => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:09.905298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:09.906920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:09.935187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc4651-5846-4cfb-bb1a-4f2b9d6c2773 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:10.018376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:10.021621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:10.171599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:10.172897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:10.173289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:10.173568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] PATH_INFO: `/v3/projects/2dde2f9516ec4d84b5d60e8a31451eb4` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:10.188655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dde2f9516ec4d84b5d60e8a31451eb4)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:10.195286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:10.241327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e667d-bcaa-47c9-9bf9-93bca122a78f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:10.255235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:10.258304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:10.258725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:10.259027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:10.265653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:10.414959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dde2f9516ec4d84b5d60e8a31451eb4', 'request_id': 'req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:10.435828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dde2f9516ec4d84b5d60e8a31451eb4', 'request_id': 'req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:10.447743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dde2f9516ec4d84b5d60e8a31451eb4', 'request_id': 'req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:10.482482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] The token cache is being invalidate because project 2dde2f9516ec4d84b5d60e8a31451eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:10.482835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:10.485035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3be573d-7271-4b42-b4e0-d2fd0257c2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:10.495040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 900/1781] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:09 2022] DELETE /identity/v3/projects/2dde2f9516ec4d84b5d60e8a31451eb4 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:10.498494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:10.503125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:10.503408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:10.508649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:10.516781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69980-4924-464f-8921-3673c71eb977 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:10.547453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 882/1782] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:10.568460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:10.569863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:10.786489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:10.838991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 901/1783] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:10.846417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:10.846873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:10.847165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:10.876850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:10.878579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:10.898428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 883/1784] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:10.902980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:10.923019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f0bc0-82ce-4f9b-8752-2c2bee271627 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:10.948117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:10.948863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:10.958315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:10.958315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:10.958315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:10.958315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:10.958315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.037711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:11.049902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 902/1785] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:11.051006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c90e9-902d-4b45-b050-37378eaf23c9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:11.068279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:11.069829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.070117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.070398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.075504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:11.078738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.174685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:11.186909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 884/1786] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:11 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:11.191077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924ef2-d21f-478e-ba56-f04c63b15cfb admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:11.384494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:11.385471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.385946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.386408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.388070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:11.392405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.466114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 903/1787] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:11 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:11.471418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:11.494986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b08ff-a870-49e2-b9c6-5251e228b3f0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:11.508643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:11.509423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.509738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.509987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.510871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:11.514798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.578806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 885/1788] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:11.584552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:11.646890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242154af-bbf4-443a-9075-1fa6634b1064 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:11.692337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:11.693120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.697314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.698681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.701851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:11.708487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.708634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:11.711146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:11.752655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 904/1789] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:11.761557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc0084-2c53-4c52-97dd-3a2eddcf3d13 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:11.769620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:11.790406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:11.791638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.799196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.799816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] PATH_INFO: `/v3/projects/0f812c84e87c4cc0b50204d3588e598d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.811072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f812c84e87c4cc0b50204d3588e598d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:11.813620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.820365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de053-004b-4075-9b88-d5d41cba1247 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:11.832024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac79bd-9ed1-46f9-9416-ce740b8041ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:11.834185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac79bd-9ed1-46f9-9416-ce740b8041ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.835713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac79bd-9ed1-46f9-9416-ce740b8041ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.836097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac79bd-9ed1-46f9-9416-ce740b8041ba admin admin] PATH_INFO: `/v3/projects/0016918c528a4cdeab85c4d025a4a724/users/b718e0aaf2a2411e94b523e334c2059c/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.857654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac79bd-9ed1-46f9-9416-ce740b8041ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0016918c528a4cdeab85c4d025a4a724, user_id=b718e0aaf2a2411e94b523e334c2059c, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:11.864066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac79bd-9ed1-46f9-9416-ce740b8041ba admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:11.907586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 905/1790] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:11 2022] PUT /identity/v3/projects/0016918c528a4cdeab85c4d025a4a724/users/b718e0aaf2a2411e94b523e334c2059c/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:11.910050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ec05b-d5e4-400e-b743-cb0858543cf7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:11.910050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ec05b-d5e4-400e-b743-cb0858543cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:11.910050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ec05b-d5e4-400e-b743-cb0858543cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:11.972722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f812c84e87c4cc0b50204d3588e598d', 'request_id': 'req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:11.976052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:11.984816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-500ec05b-d5e4-400e-b743-cb0858543cf7 None None] MFA Rules not processed for user `b718e0aaf2a2411e94b523e334c2059c`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:11.987699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-500ec05b-d5e4-400e-b743-cb0858543cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:12.002965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f812c84e87c4cc0b50204d3588e598d', 'request_id': 'req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:12.022823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f812c84e87c4cc0b50204d3588e598d', 'request_id': 'req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:12.073688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] The token cache is being invalidate because project 0f812c84e87c4cc0b50204d3588e598d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:12.074320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:12.075360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-73bff453-4982-4ccf-8f6b-e0cbcf6afbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:12.083804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 886/1791] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:11 2022] DELETE /identity/v3/projects/0f812c84e87c4cc0b50204d3588e598d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:12.083804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.086777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.089488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.165003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] MFA Rules not processed for user `e1e6349a50ec4554b27b94b3f0f2dcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:12.166201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:12.276337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 906/1792] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:12.276337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ee92-1d24-42ec-b4e3-87be6b20b40f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.276337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ee92-1d24-42ec-b4e3-87be6b20b40f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.276337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ee92-1d24-42ec-b4e3-87be6b20b40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.325094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-44d9ee92-1d24-42ec-b4e3-87be6b20b40f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:12.326406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-44d9ee92-1d24-42ec-b4e3-87be6b20b40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:12.375795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:12.376162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 887/1793] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:12.377599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.379284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:12.490488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 907/1794] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:12.496000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.496290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.496563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.527028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:12.528249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:12.551229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 908/1795] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:12.558444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.582386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16650d44-29b5-4c65-a700-48af14be50c6 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.592918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.593646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.594008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.594276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.595018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:12.595969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:12.597767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:12.598159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01802de-7c91-4a1e-8869-1fadad1f0e7a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.615169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.615876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.616205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.616421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.617166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:12.621314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:12.638079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 909/1796] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:12.639619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.655422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f660c-6107-4b2c-95eb-56b73d9f67c1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.689711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.690278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.690632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.693742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.693859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 888/1797] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/projects => generated 393 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:12.693938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:12.694552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:12.694966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.771090 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 910/1798] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:12.772015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.819758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06f2b1-0872-4f1a-a4f7-bf8eb31e083d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.848999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:12.918825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.919716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.920208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.920602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.921607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:12.924379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:12.925363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918ea56-c608-4ca7-a865-bb637fb6272b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.931196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.941284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.941284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.941284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.941284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:12.941284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:12.954498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 889/1799] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/users => generated 303 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:12.959921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.968500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 911/1800] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:12 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:12.972993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:12.980934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c483cbd-f25b-4ccd-9aeb-72ca97620b5e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.989957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.990250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ab65e-1bd3-4769-85b2-276fac6ad2c6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:12.990805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.991144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.991478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.992369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:12.994078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:12.996523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:12.997354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:12.998057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:12.998558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:12.999510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.002666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.008269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 890/1801] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:13.012574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.023890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1a7f-0e52-4b38-8369-e677cc639fff admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.026309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 912/1802] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:13.027257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.029910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.030937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.031402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.031772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] PATH_INFO: `/v3/projects/9a9007e9712c405aaa8f11aede651bc0/users/a970ffa4914a4843a559974f622a7641/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.043163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915fe1-ed05-4fbc-b8a7-9db19ad91eed admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.049477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9007e9712c405aaa8f11aede651bc0, user_id=a970ffa4914a4843a559974f622a7641, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.052098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.052793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.052995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.053146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.053430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.054170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.057241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.073674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 913/1803] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:13.078704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.082972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 891/1804] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:13 2022] PUT /identity/v3/projects/9a9007e9712c405aaa8f11aede651bc0/users/a970ffa4914a4843a559974f622a7641/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:13.084581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.097287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330187-81e6-43f7-b63e-74bc14dd0f83 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.186704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:13.203565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b370c-328f-4b8d-afa3-7c712a0e94dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.204610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b370c-328f-4b8d-afa3-7c712a0e94dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.205540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b370c-328f-4b8d-afa3-7c712a0e94dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.205829 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b370c-328f-4b8d-afa3-7c712a0e94dc admin admin] PATH_INFO: `/v3/projects/af5d5b272a0e4fb387e0aaa64d9f632b/users/da499c119c214e6899ffa7fe75f919b9/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.207590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ddaf-dcde-43ab-9240-608c96903da7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.213221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.214185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.214564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.214943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.215808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.217760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.232142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b370c-328f-4b8d-afa3-7c712a0e94dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5d5b272a0e4fb387e0aaa64d9f632b, user_id=da499c119c214e6899ffa7fe75f919b9, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.232760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 892/1805] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:13.235569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b370c-328f-4b8d-afa3-7c712a0e94dc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.237347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.251413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443c14-eee3-4a13-b994-f510fbe72fd9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.256166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 914/1806] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:13 2022] PUT /identity/v3/projects/af5d5b272a0e4fb387e0aaa64d9f632b/users/da499c119c214e6899ffa7fe75f919b9/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:13.267358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.267635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.267838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.304203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] MFA Rules not processed for user `da499c119c214e6899ffa7fe75f919b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:13.306368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:13.333678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd004105-5d29-483d-9dc8-53f03efc3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.334623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004105-5d29-483d-9dc8-53f03efc3f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.334953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004105-5d29-483d-9dc8-53f03efc3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.336052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004105-5d29-483d-9dc8-53f03efc3f0b admin admin] PATH_INFO: `/v3/projects/9a9007e9712c405aaa8f11aede651bc0/users/a970ffa4914a4843a559974f622a7641/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.337390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd004105-5d29-483d-9dc8-53f03efc3f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9007e9712c405aaa8f11aede651bc0, user_id=a970ffa4914a4843a559974f622a7641, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.340527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd004105-5d29-483d-9dc8-53f03efc3f0b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.349955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:13.358265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 893/1807] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:13 2022] PUT /identity/v3/projects/9a9007e9712c405aaa8f11aede651bc0/users/a970ffa4914a4843a559974f622a7641/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:13.369792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.370085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.370478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.405428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] MFA Rules not processed for user `a970ffa4914a4843a559974f622a7641`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:13.407016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:13.467548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 915/1808] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:13.470791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.533413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 894/1809] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:13.545383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.548823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a93fd-516e-4358-ace7-997721ba34f2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.550116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:13.678220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.679124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.679481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.679849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.680659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.682829 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.686174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5ad87-70e8-48dd-85ce-2cc796c2c23d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.697748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.698587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.698720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.699080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.711119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.712967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.733313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 895/1810] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:13.738838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 916/1811] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:13 2022] POST /identity/v3/projects => generated 367 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:13.743520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.764461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bf247-6441-45cc-adc2-565746c4f52d service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.836384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.838356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:13.916993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:13.920972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.922328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.922953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.923342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.924035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.924725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7753d99-5dd3-4851-b36b-9acf31f307b5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.926506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:13.929266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.929932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.930220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.930498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.960328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 896/1812] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:13 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:13.961577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:13.977800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a064341-9f17-41b1-808a-1082e6b568bb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:13.986082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:13.987335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:13.987847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:13.988661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:13.989918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:13.991722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.007132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 897/1813] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:14.008148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:14.015566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:14.017280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.018928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab91780-89e6-4925-88e8-fece9fd96f09 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:14.023844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:14.024823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:14.025245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:14.025594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] PATH_INFO: `/v3/projects/da6cf6b821d04783ae331a1be72f2257/users/500f5ad1c2fd4c40b693fbcc303c32e2/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:14.027857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 917/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:14.028595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:14.046076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6cf6b821d04783ae331a1be72f2257, user_id=500f5ad1c2fd4c40b693fbcc303c32e2, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:14.048908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.064758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 898/1815] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:14 2022] PUT /identity/v3/projects/da6cf6b821d04783ae331a1be72f2257/users/500f5ad1c2fd4c40b693fbcc303c32e2/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:14.068820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:14.081605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5dc8d-b627-4eb7-8866-9b90c99b2a35 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:14.144785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cfa37-a713-4317-a99f-45cb9d483a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:14.145939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfa37-a713-4317-a99f-45cb9d483a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:14.145939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfa37-a713-4317-a99f-45cb9d483a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:14.146146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfa37-a713-4317-a99f-45cb9d483a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:14.146761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cfa37-a713-4317-a99f-45cb9d483a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:14.148387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cfa37-a713-4317-a99f-45cb9d483a0f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.159523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 918/1816] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:14.164128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:14.175835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afde94-3e62-460a-9c88-c8a23dcd8229 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:14.181591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:14.183045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:14.183330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:14.184200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] PATH_INFO: `/v3/projects/da6cf6b821d04783ae331a1be72f2257/users/500f5ad1c2fd4c40b693fbcc303c32e2/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:14.186467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6cf6b821d04783ae331a1be72f2257, user_id=500f5ad1c2fd4c40b693fbcc303c32e2, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:14.189544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.203489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 899/1817] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:14 2022] PUT /identity/v3/projects/da6cf6b821d04783ae331a1be72f2257/users/500f5ad1c2fd4c40b693fbcc303c32e2/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:14.214631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:14.214862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:14.215146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:14.243745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] MFA Rules not processed for user `500f5ad1c2fd4c40b693fbcc303c32e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:14.245005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:14.320369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 919/1818] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:14.333291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:14.393814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853822-556d-4e94-897f-2e327698f622 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:14.398029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:14.398691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:14.398977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:14.399354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:14.409113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:14.410555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.419860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 900/1819] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:14.469177 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:14.479231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca643-964e-4070-a686-01b2e481e3b1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:14.482862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:14.483504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:14.483785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:14.484056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:14.505559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:14.540948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:14.542487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:14.551585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 920/1820] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:18.259776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:18.261509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:18.453653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078ab0b-773f-4bdf-9346-21097e4004fd service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:18.460344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:18.461824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:18.462121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:18.462401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] PATH_INFO: `/v3/users/f2da4842a1fd472fb6e1575c009de4f5` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:18.463850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2da4842a1fd472fb6e1575c009de4f5)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:18.466594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:18.587711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2da4842a1fd472fb6e1575c009de4f5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.590052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2da4842a1fd472fb6e1575c009de4f5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.591222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2da4842a1fd472fb6e1575c009de4f5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.607942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2da4842a1fd472fb6e1575c009de4f5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.615309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:18.631855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0c495278-20c5-4799-9948-16c71504b75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2da4842a1fd472fb6e1575c009de4f5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.634320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:18.644834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148552-5a9f-4713-b083-0fcfa22eafb8 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:18.667457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:18.668143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:18.668428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:18.668805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] PATH_INFO: `/v3/users/da499c119c214e6899ffa7fe75f919b9` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:18.669950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da499c119c214e6899ffa7fe75f919b9)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:18.679692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:18.681136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 901/1821] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:18 2022] DELETE /identity/v3/users/f2da4842a1fd472fb6e1575c009de4f5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:18.684278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:18.684876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:18.685577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:18.711824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:18.713550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:18.792342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da499c119c214e6899ffa7fe75f919b9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.793093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da499c119c214e6899ffa7fe75f919b9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.793826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da499c119c214e6899ffa7fe75f919b9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.803966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da499c119c214e6899ffa7fe75f919b9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.829835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 902/1822] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:18.839598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:18.842027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:18.856985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a2fad35e-36b9-498f-966c-21aeb847605b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da499c119c214e6899ffa7fe75f919b9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:18.879055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 921/1823] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:18 2022] DELETE /identity/v3/users/da499c119c214e6899ffa7fe75f919b9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:18.885629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:18.885954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:18.886267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:18.926169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:18.928063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:18.977047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9294-e98a-44fe-b810-ddc26c7feee7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:19.028585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 922/1824] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:19.038615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:19.058984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:19.059935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:19.061179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:19.062372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:19.073840 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:19.075419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:19.089355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:19.094953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 903/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:19.117292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60ca7-922e-4ae8-827f-ec3965411653 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:19.117292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:19.117292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:19.117292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:19.117911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:19.135626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:19.137132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:19.148193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 923/1826] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:19.640685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:19.640685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:19.659686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097899-c8b1-459f-801f-95649ddb7b1a service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:19.659907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:19.661562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:19.664932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:19.666007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:19.666290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:19.666691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] PATH_INFO: `/v3/projects/523c769801c747d2bfd5c835c7248ce6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:19.668310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523c769801c747d2bfd5c835c7248ce6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:19.669899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:19.681542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a23488-514e-4f24-9e96-5b633602cab1 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:19.688031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:19.689422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:19.689732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:19.690151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] PATH_INFO: `/v3/projects/af5d5b272a0e4fb387e0aaa64d9f632b` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:19.691677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5d5b272a0e4fb387e0aaa64d9f632b)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:19.694060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:19.718856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=1,keystone:DELETE=4,keystone:SELECT=95 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:19.722230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523c769801c747d2bfd5c835c7248ce6', 'request_id': 'req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.731397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523c769801c747d2bfd5c835c7248ce6', 'request_id': 'req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.737639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523c769801c747d2bfd5c835c7248ce6', 'request_id': 'req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.746311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5d5b272a0e4fb387e0aaa64d9f632b', 'request_id': 'req-7a78a56c-29fb-4817-812d-c22f84da602d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.749535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] The token cache is being invalidate because project 523c769801c747d2bfd5c835c7248ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:19.750120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.750905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.753055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 904/1827] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:19 2022] DELETE /identity/v3/projects/523c769801c747d2bfd5c835c7248ce6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:19.754718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5d5b272a0e4fb387e0aaa64d9f632b', 'request_id': 'req-7a78a56c-29fb-4817-812d-c22f84da602d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.757993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:19.759318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:19.761164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5d5b272a0e4fb387e0aaa64d9f632b', 'request_id': 'req-7a78a56c-29fb-4817-812d-c22f84da602d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.772567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] The token cache is being invalidate because project af5d5b272a0e4fb387e0aaa64d9f632b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:19.772986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.773676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.775235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 924/1828] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:19 2022] DELETE /identity/v3/projects/af5d5b272a0e4fb387e0aaa64d9f632b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:19.778953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:19.780281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:19.823931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0e7f2-7274-4b84-8dc1-77a3cc85c4f4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:19.843804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a56c-29fb-4817-812d-c22f84da602d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:19.848346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:19.849254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:19.849529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:19.849804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] PATH_INFO: `/v3/users/500f5ad1c2fd4c40b693fbcc303c32e2` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:19.851113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=500f5ad1c2fd4c40b693fbcc303c32e2)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:19.853059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:19.881289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:19.882285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:19.882591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:19.882889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] PATH_INFO: `/v3/users/6c9e421db08e4235b8b808d652e850d3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:19.884138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9e421db08e4235b8b808d652e850d3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:19.886488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:19.910004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500f5ad1c2fd4c40b693fbcc303c32e2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.910771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500f5ad1c2fd4c40b693fbcc303c32e2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.911559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500f5ad1c2fd4c40b693fbcc303c32e2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.920102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500f5ad1c2fd4c40b693fbcc303c32e2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.928739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:19.938753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500f5ad1c2fd4c40b693fbcc303c32e2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.940336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9e421db08e4235b8b808d652e850d3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.941026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9e421db08e4235b8b808d652e850d3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.941652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9e421db08e4235b8b808d652e850d3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.954572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9e421db08e4235b8b808d652e850d3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.958103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 925/1829] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:19 2022] DELETE /identity/v3/users/500f5ad1c2fd4c40b693fbcc303c32e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:19.987772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9e421db08e4235b8b808d652e850d3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:19.998626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.004390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 905/1830] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:19 2022] DELETE /identity/v3/users/6c9e421db08e4235b8b808d652e850d3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:20.216362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.217854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.312724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c732-19e5-4dff-a8be-6f14ee1f3ade admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.387374 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.388911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.423293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.424649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.425006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.425362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] PATH_INFO: `/v3/users/b718e0aaf2a2411e94b523e334c2059c` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.426962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b718e0aaf2a2411e94b523e334c2059c)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.429275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.508770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8a6f2-3b61-42c4-825f-3730617f2fa9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.513438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.514317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.514595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.514868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] PATH_INFO: `/v3/projects/da6cf6b821d04783ae331a1be72f2257` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.516263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6cf6b821d04783ae331a1be72f2257)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.518197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.518949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b718e0aaf2a2411e94b523e334c2059c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.519665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b718e0aaf2a2411e94b523e334c2059c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.520316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b718e0aaf2a2411e94b523e334c2059c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.527968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b718e0aaf2a2411e94b523e334c2059c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.540502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b718e0aaf2a2411e94b523e334c2059c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.555397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 926/1831] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:20 2022] DELETE /identity/v3/users/b718e0aaf2a2411e94b523e334c2059c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:20.556367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.557721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.567064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.570260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6cf6b821d04783ae331a1be72f2257', 'request_id': 'req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.580049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6cf6b821d04783ae331a1be72f2257', 'request_id': 'req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.586529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6cf6b821d04783ae331a1be72f2257', 'request_id': 'req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.599711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] The token cache is being invalidate because project da6cf6b821d04783ae331a1be72f2257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:20.599711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.599711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-05ee5a04-0a72-4cf7-b57e-568e0d625dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.601385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 906/1832] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:20 2022] DELETE /identity/v3/projects/da6cf6b821d04783ae331a1be72f2257 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:20.602697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27f93-d92d-42d9-87d3-c25cbf154dd7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.602986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27f93-d92d-42d9-87d3-c25cbf154dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.603264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27f93-d92d-42d9-87d3-c25cbf154dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.628351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-21e27f93-d92d-42d9-87d3-c25cbf154dd7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:20.629595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-21e27f93-d92d-42d9-87d3-c25cbf154dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.632713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d55be-2ca3-4d30-ad1b-f2066ab7cbe1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.637712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.638203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 907/1833] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:20.638857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.639367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.639637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.639759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] PATH_INFO: `/v3/projects/a70f4700943f470b9afac510ff3b0498` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.639925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.640246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.646426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70f4700943f470b9afac510ff3b0498)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.648678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.660287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:20.661642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.672203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 908/1834] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:20.672203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.674729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.699813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70f4700943f470b9afac510ff3b0498', 'request_id': 'req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.714146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70f4700943f470b9afac510ff3b0498', 'request_id': 'req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.721443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70f4700943f470b9afac510ff3b0498', 'request_id': 'req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.733696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] The token cache is being invalidate because project a70f4700943f470b9afac510ff3b0498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:20.733990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.735100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-09e4feae-6f6a-4f3a-9066-ac1b565ae3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:20.737000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 927/1835] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:20 2022] DELETE /identity/v3/projects/a70f4700943f470b9afac510ff3b0498 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:20.738259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52206c77-8227-4d14-8a25-795b9daecdb9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.738540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52206c77-8227-4d14-8a25-795b9daecdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.738813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52206c77-8227-4d14-8a25-795b9daecdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.743700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e14d2-3b9f-4f5a-b6cf-8a3c7c3bc5b5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.756920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-52206c77-8227-4d14-8a25-795b9daecdb9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:20.758131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-52206c77-8227-4d14-8a25-795b9daecdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.774012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.796597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.797757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.798045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.798321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.800181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.817475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 928/1836] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:20.818781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.819072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.819351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.837781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:20.839001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.847210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 929/1837] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:20.848737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.858306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83767189-ad24-4ec8-bfe0-fe74e2a874b5 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.863139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.863792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.864073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.864346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.865110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:20.865417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.867018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d17e9-ee2e-4e49-8f9c-43e91bfb8588 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.868435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.869843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.882322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 930/1838] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:20.882499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 909/1839] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:20.882583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433f019-4e55-4d76-bff9-06209537642c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.882583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433f019-4e55-4d76-bff9-06209537642c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.882583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433f019-4e55-4d76-bff9-06209537642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.883328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.892681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6975b9-50ef-453b-a4d2-0faaaa09b951 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.897603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.898282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.898563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.898836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.898954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c433f019-4e55-4d76-bff9-06209537642c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:20.899549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.900027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c433f019-4e55-4d76-bff9-06209537642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:20.901459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.908757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 931/1840] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:20.912834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433f019-4e55-4d76-bff9-06209537642c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.922307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433f019-4e55-4d76-bff9-06209537642c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:20.929116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:20.929982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:20.930384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:20.930701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:20.931587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:20.931997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:20.935862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 910/1841] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:20.935997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:20.937056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.942880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.951106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 932/1842] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:12:20.955536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:20.968330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2600-bed1-499b-b0ab-538547da50ab admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.013760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a21e5-d447-40cb-843d-234fcddffc4f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.018951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.019812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.020104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.020378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.021114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.023047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.037052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.037990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.038405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.038771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.039543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.041776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.055806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 911/1843] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:21.058153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.070532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabf166-9e8f-4c15-a8c9-d6fd610d5856 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.073814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 933/1844] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:20 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:21.078892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.136038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:21.157408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.160569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc933b3-57a6-4c3d-b272-7f1a3380b0f3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.162924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.163225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.163508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.164480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.166396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.169695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.172793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.173160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.173447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.174401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.177909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 912/1845] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:21.178551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.182227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.196842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8ed9-1c0a-406c-8840-9f798132a184 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.203957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.204896 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.205280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.205665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.206552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.207236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 934/1846] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:21 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:21.207946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.208432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.210150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.222864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 913/1847] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:21.225937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.226360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9c683-7223-482c-9bb2-465b36036478 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.231482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.232457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.232812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.233186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] PATH_INFO: `/v3/projects/0016918c528a4cdeab85c4d025a4a724` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.234551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0016918c528a4cdeab85c4d025a4a724)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.236713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.240315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fe0ba-27b6-4525-b040-94db17f2e6d0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.245371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.246179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.246461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.246732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.248057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.250287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.268065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 914/1848] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:21.268065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.279640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1f8ae-fa4e-4243-a947-0ee1515a6624 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.285523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.286589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.286870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.287260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] PATH_INFO: `/v3/projects/d1af223b4fec443ebf8079dfbf424b48/users/e88b0f9aad1142a0a46b2f202983e955/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.304271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0016918c528a4cdeab85c4d025a4a724', 'request_id': 'req-0cda1db7-249c-4b83-891c-f5ca7852eac6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.306190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1af223b4fec443ebf8079dfbf424b48, user_id=e88b0f9aad1142a0a46b2f202983e955, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.309408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.317103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0016918c528a4cdeab85c4d025a4a724', 'request_id': 'req-0cda1db7-249c-4b83-891c-f5ca7852eac6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.323026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0016918c528a4cdeab85c4d025a4a724', 'request_id': 'req-0cda1db7-249c-4b83-891c-f5ca7852eac6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.325066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:21.330324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 915/1849] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:21 2022] PUT /identity/v3/projects/d1af223b4fec443ebf8079dfbf424b48/users/e88b0f9aad1142a0a46b2f202983e955/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:21.331161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.346320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] The token cache is being invalidate because project 0016918c528a4cdeab85c4d025a4a724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:21.346612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.347312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0cda1db7-249c-4b83-891c-f5ca7852eac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.349101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 935/1850] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:21 2022] DELETE /identity/v3/projects/0016918c528a4cdeab85c4d025a4a724 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:21.350314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.350599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.350877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.376660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] MFA Rules not processed for user `e88b0f9aad1142a0a46b2f202983e955`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:21.378354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.399918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519a1a-e7e8-42c9-a42d-50bf753c22fd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.404663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.405608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.405886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.406339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.407024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.408619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.419495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 916/1851] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:21.420446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.424032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.437852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111636e7-dd92-45ef-b5a5-04c41f64044d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.442819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.443720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.444000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.444276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] PATH_INFO: `/v3/users/a970ffa4914a4843a559974f622a7641` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.445510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a970ffa4914a4843a559974f622a7641)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.447439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.480389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 936/1852] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:21.480389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.480389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.496620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75ae0-3595-4764-afd8-7eaf392f4989 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.501617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.502947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.503229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.503506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] PATH_INFO: `/v3/projects/dd0352bc319d4c1f98991c58ce43dea7/users/96fd8dc4485944168e1d3c24edf5bdc7/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.509533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a970ffa4914a4843a559974f622a7641'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.510245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a970ffa4914a4843a559974f622a7641'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.510868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a970ffa4914a4843a559974f622a7641'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.519369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a970ffa4914a4843a559974f622a7641'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.521581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0352bc319d4c1f98991c58ce43dea7, user_id=96fd8dc4485944168e1d3c24edf5bdc7, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.524383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.535331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e665ac79-51f6-4f6c-8eea-57c2502a4d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a970ffa4914a4843a559974f622a7641'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.540749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 937/1853] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:21 2022] PUT /identity/v3/projects/dd0352bc319d4c1f98991c58ce43dea7/users/96fd8dc4485944168e1d3c24edf5bdc7/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:21.541763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.543738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.553138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 917/1854] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:21 2022] DELETE /identity/v3/users/a970ffa4914a4843a559974f622a7641 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:21.554945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.555345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.555699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.587016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:21.616114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] MFA Rules not processed for user `96fd8dc4485944168e1d3c24edf5bdc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:21.617526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.625214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f3b6e-5103-48b5-b3a4-9d2ea77e587f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.695614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 918/1855] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:21.700161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.702135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.710840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.711656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.711936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.712677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.715037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.754699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:21.795101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.796672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.805806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00e494-2cd3-40b3-8ce2-ea21603e2906 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.810601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.811289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.811573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.811845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.813135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.814286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 938/1856] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:21.823242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.834507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.837999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.858542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca367-058d-4167-a6e1-08a2231cf230 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.864049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.864950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.865283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.865574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] PATH_INFO: `/v3/users/e88b0f9aad1142a0a46b2f202983e955` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.867097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88b0f9aad1142a0a46b2f202983e955)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.869515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.873342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 919/1857] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:21 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:21.877991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.930287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88b0f9aad1142a0a46b2f202983e955'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.931298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88b0f9aad1142a0a46b2f202983e955'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.931911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88b0f9aad1142a0a46b2f202983e955'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.938967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88b0f9aad1142a0a46b2f202983e955'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.951017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88b0f9aad1142a0a46b2f202983e955'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:21.953144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61262847-9f44-4913-9ce6-97004920c727 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:21.958438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ec0b-dca4-4e81-bd56-d2fcabfe3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:21.959177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ec0b-dca4-4e81-bd56-d2fcabfe3f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.959518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ec0b-dca4-4e81-bd56-d2fcabfe3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.959815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ec0b-dca4-4e81-bd56-d2fcabfe3f74 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:21.960558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590ec0b-dca4-4e81-bd56-d2fcabfe3f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:21.962528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590ec0b-dca4-4e81-bd56-d2fcabfe3f74 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:21.966058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 939/1858] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:21 2022] DELETE /identity/v3/users/e88b0f9aad1142a0a46b2f202983e955 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:21.966893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:21.968289 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:21.984009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 920/1859] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:21 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:21.985887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:21.986205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:21.986473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.004791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:22.006313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.015700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:22.041946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71208b0-a5ef-4989-a495-b46f1be30c06 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.047438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.048416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.048703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.048982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] PATH_INFO: `/v3/projects/9a9007e9712c405aaa8f11aede651bc0` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.050327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9007e9712c405aaa8f11aede651bc0)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.052475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.074392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 921/1860] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:22.075617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.077258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.091712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd06a1b-12c8-4cab-b64d-9ebcea2ed92e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.102452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:22.108305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9007e9712c405aaa8f11aede651bc0', 'request_id': 'req-868f1792-ac84-4870-b99e-d4780bcface7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.117400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9007e9712c405aaa8f11aede651bc0', 'request_id': 'req-868f1792-ac84-4870-b99e-d4780bcface7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.124884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9007e9712c405aaa8f11aede651bc0', 'request_id': 'req-868f1792-ac84-4870-b99e-d4780bcface7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.137418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] The token cache is being invalidate because project 9a9007e9712c405aaa8f11aede651bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:22.137711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.138383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.139998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 940/1861] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:21 2022] DELETE /identity/v3/projects/9a9007e9712c405aaa8f11aede651bc0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:22.141326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.142718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.154690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935acfe1-eebf-4320-81ee-95ef084a375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.155381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935acfe1-eebf-4320-81ee-95ef084a375b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.155665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935acfe1-eebf-4320-81ee-95ef084a375b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.156261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935acfe1-eebf-4320-81ee-95ef084a375b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.157045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935acfe1-eebf-4320-81ee-95ef084a375b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.158668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935acfe1-eebf-4320-81ee-95ef084a375b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.169218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 922/1862] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:22.170558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.170848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.171138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.189892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:22.191103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.199051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 923/1863] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:22.200009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.201169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.209076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1792-ac84-4870-b99e-d4780bcface7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.212662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.213128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580ca1-b415-4f06-9613-b6a495bf1481 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.213371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.213654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.213929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.215749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.217701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.218797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.219114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.219600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] PATH_INFO: `/v3/projects/2b8f23f31ae64d7fa4f8781115c4bfc9/users/5665eaf82dff4b028d5b60ca2842d697/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.228181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.229984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e2b15-9b65-4126-b65b-baccbffc605e service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.236820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8f23f31ae64d7fa4f8781115c4bfc9, user_id=5665eaf82dff4b028d5b60ca2842d697, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.239503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.239814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 941/1864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:22.241167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.241460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.241737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.254563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 924/1865] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:22 2022] PUT /identity/v3/projects/2b8f23f31ae64d7fa4f8781115c4bfc9/users/5665eaf82dff4b028d5b60ca2842d697/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:22.258159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.267496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:22.269875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.348462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fa6d-f93f-45bc-ad8d-4f21bd4438c0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.353846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.354621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.355015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.355352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.356355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.358155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.358946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 942/1866] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:22.365144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.375916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327e455-cd47-4d9f-84b8-b6ac092bcb43 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.381589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.382337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.382603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.382882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.383711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:22.383946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.385710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.393292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 925/1867] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:22.395344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.399871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 943/1868] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:22.403961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.407601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923241ec-0c8a-4adf-a3c3-e2489f12d12f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.412778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146eb4-c4f9-4b8a-a265-0765848783b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.413709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146eb4-c4f9-4b8a-a265-0765848783b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.413986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146eb4-c4f9-4b8a-a265-0765848783b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.414262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146eb4-c4f9-4b8a-a265-0765848783b5 admin admin] PATH_INFO: `/v3/projects/2b8f23f31ae64d7fa4f8781115c4bfc9/users/5665eaf82dff4b028d5b60ca2842d697/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.414657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a455201-d46c-453b-9b01-7ed24ce4deb6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.417230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146eb4-c4f9-4b8a-a265-0765848783b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8f23f31ae64d7fa4f8781115c4bfc9, user_id=5665eaf82dff4b028d5b60ca2842d697, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.419595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.420555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146eb4-c4f9-4b8a-a265-0765848783b5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.420714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.420714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.421157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.421752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.423718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.445097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 926/1869] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:22 2022] PUT /identity/v3/projects/2b8f23f31ae64d7fa4f8781115c4bfc9/users/5665eaf82dff4b028d5b60ca2842d697/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:22.452631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.453504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.453877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.464704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:22.470466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 944/1870] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:22 2022] POST /identity/v3/projects => generated 399 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:22.471393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.498825 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] MFA Rules not processed for user `5665eaf82dff4b028d5b60ca2842d697`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:22.501143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.576192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:22.647285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 927/1871] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:22.655368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3be53-2666-416d-9acc-159143a35504 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.673857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.674590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.674936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.675221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.677083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.678822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.680901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.682447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.734927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 945/1872] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:22 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:22.735873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.741215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.765639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f083-5391-4811-92e4-3728ba5f6626 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.773280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.774180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.774460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.774738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] PATH_INFO: `/v3/projects/d1af223b4fec443ebf8079dfbf424b48` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.775778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579968-68df-4a3c-8a65-a4aee4b4b80b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.776809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1af223b4fec443ebf8079dfbf424b48)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.778968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.808350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.809107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.809391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.809666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.825436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.827501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.839200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 928/1873] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:22.840052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.850934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af44fc8-826b-4484-8e85-87a4df6063c3 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.871349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1af223b4fec443ebf8079dfbf424b48', 'request_id': 'req-0c1fd29c-4630-4c40-98ef-f0e20af34c40'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.886524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1af223b4fec443ebf8079dfbf424b48', 'request_id': 'req-0c1fd29c-4630-4c40-98ef-f0e20af34c40'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.895539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1af223b4fec443ebf8079dfbf424b48', 'request_id': 'req-0c1fd29c-4630-4c40-98ef-f0e20af34c40'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.911584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] The token cache is being invalidate because project d1af223b4fec443ebf8079dfbf424b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:22.911945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.912782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0c1fd29c-4630-4c40-98ef-f0e20af34c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:22.916830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 946/1874] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:22 2022] DELETE /identity/v3/projects/d1af223b4fec443ebf8079dfbf424b48 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:22.922169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.922594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.922711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.935019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.935715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.935997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.936955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.937790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.940052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.953646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 929/1875] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:22.955246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.957229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.960815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:22.962042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:22.972371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31ce7-b0cc-4fb4-b152-ce097e118078 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:22.977038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1db0e-6116-4790-85cf-ef2fa7e6864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:22.977853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1db0e-6116-4790-85cf-ef2fa7e6864c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:22.978147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1db0e-6116-4790-85cf-ef2fa7e6864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:22.978568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1db0e-6116-4790-85cf-ef2fa7e6864c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:22.979351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1db0e-6116-4790-85cf-ef2fa7e6864c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:22.980907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1db0e-6116-4790-85cf-ef2fa7e6864c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:22.983641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 947/1876] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:22.983641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:22.985069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.004979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 930/1877] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:23.013785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.014073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.014354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.043585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:23.044777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.050506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a14d7b-fb5e-4119-93d8-368cba76e75c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.053262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 931/1878] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:23.054579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.057356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.058033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.058319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.058597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.060471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.068461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7677-d174-46e8-935b-1a0006399624 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.073617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.074524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.074804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.075083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] PATH_INFO: `/v3/projects/88b9cd2d6d11459c9c7f2cbfa201ac25/users/fc1426b280c14437a02cf2e22ce67325/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.084564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.092576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b9cd2d6d11459c9c7f2cbfa201ac25, user_id=fc1426b280c14437a02cf2e22ce67325, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.095680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.110455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 932/1879] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:23 2022] PUT /identity/v3/projects/88b9cd2d6d11459c9c7f2cbfa201ac25/users/fc1426b280c14437a02cf2e22ce67325/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:23.111293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.139542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.141108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bd49d-cc39-4978-a1a5-5318d58e5db4 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.151991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 948/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:23.155515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.155813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.156468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.163048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.186905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] MFA Rules not processed for user `fc1426b280c14437a02cf2e22ce67325`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:23.188174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.191801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0a3cc-9bc3-455e-811c-cd64ba73c5a2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.197990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.198684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.198964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.199236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.199977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:23.200309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.202079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.214728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 933/1881] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:23.219563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.230815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1dc9c-3bf3-4f45-8c6d-855161c02b8d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.236329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.236850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.237167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.237446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.238148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.240073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.259795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 949/1882] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:23.264256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.278477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ce49c-4187-48a9-9a7e-960896634578 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.278642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 934/1883] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:23.279488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.342690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.343793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.344307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.344539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.345367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.352886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.354294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e86b-65f0-4162-b4a3-cdacc0a3aeb5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.359668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.360347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.360633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.360934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.361654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.363575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.381981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 950/1884] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:23.384504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 935/1885] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:23.388555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.388660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.400541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744304e3-3831-4057-a28a-ef8cfe093282 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.460282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.477608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.478775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.479068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611c0b-95cd-4dff-95dd-ebdcb6efbd29 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.482794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.483083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.483855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.483969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.484796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.485114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.485391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.485648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.486103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.488042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.500327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 936/1886] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:23.504976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.513248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 951/1887] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/users => generated 307 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:23.515706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa4d1-992c-448a-80db-72fa1cd95bb3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.517212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.522860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.523931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.524131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.524450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.525250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.526884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.527143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee193-d68b-4cf3-b032-5ec4ce2c4e15 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.532011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.532617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.532899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.533686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.534428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.536380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.537902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.540643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 937/1888] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:23.544786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.550812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 952/1889] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:23.555119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.555494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941e1e-4334-4fda-b515-49afc3afe348 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.560932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbddea-096b-4de3-8885-5c754834b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.561897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbddea-096b-4de3-8885-5c754834b08d admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.562223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbddea-096b-4de3-8885-5c754834b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.562505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbddea-096b-4de3-8885-5c754834b08d admin admin] PATH_INFO: `/v3/projects/56eca409cb874456afc7f0acc51c7e40/users/aaefc46a7e6d431c9eebc5233389c61e/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.565429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad1ae-44e9-4109-a0db-8848feb26e5f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.570109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.570994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.571272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.571543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] PATH_INFO: `/v3/projects/d35577d99d15411e9791ee866e260644/users/9f2926c753f74a7e818c166388735b38/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.579803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbddea-096b-4de3-8885-5c754834b08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eca409cb874456afc7f0acc51c7e40, user_id=aaefc46a7e6d431c9eebc5233389c61e, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.582688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbddea-096b-4de3-8885-5c754834b08d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.588367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35577d99d15411e9791ee866e260644, user_id=9f2926c753f74a7e818c166388735b38, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.591417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.597383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 938/1890] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:23 2022] PUT /identity/v3/projects/56eca409cb874456afc7f0acc51c7e40/users/aaefc46a7e6d431c9eebc5233389c61e/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:23.602063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.602364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.602635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.613519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 953/1891] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:23 2022] PUT /identity/v3/projects/d35577d99d15411e9791ee866e260644/users/9f2926c753f74a7e818c166388735b38/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:23.617728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.621631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:23.622824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.685872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 939/1892] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:23.689095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1207-f125-4704-8e4c-3c64a13cc9c2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.695200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.695862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.695970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.696141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.696449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.697192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.697462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.698959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.713049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 954/1893] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:23.714786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.725315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8431b-4878-4e00-87f7-24e700e39aa9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.730207 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315977-71f4-48e8-8eaa-f96b7c3f3efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.731102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315977-71f4-48e8-8eaa-f96b7c3f3efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.731383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315977-71f4-48e8-8eaa-f96b7c3f3efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.731655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315977-71f4-48e8-8eaa-f96b7c3f3efa admin admin] PATH_INFO: `/v3/projects/d35577d99d15411e9791ee866e260644/users/9f2926c753f74a7e818c166388735b38/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.734449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a315977-71f4-48e8-8eaa-f96b7c3f3efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35577d99d15411e9791ee866e260644, user_id=9f2926c753f74a7e818c166388735b38, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.737333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a315977-71f4-48e8-8eaa-f96b7c3f3efa admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.748861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 955/1894] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:23 2022] PUT /identity/v3/projects/d35577d99d15411e9791ee866e260644/users/9f2926c753f74a7e818c166388735b38/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:23.759644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.759950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b947-da37-4fab-b7ba-e6c5d468b90b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:23.760066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.760261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.791996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] MFA Rules not processed for user `9f2926c753f74a7e818c166388735b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:23.793168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.831166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:23.831890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:23.832169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:23.832339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:23.870182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.897720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 956/1895] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:23.914170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:23.915588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:23.943671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:23.945159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:23.958628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 940/1896] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:23.986687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:24.006302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185a908-2844-4b87-8d9d-2a3cbcbaaabb None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:24.017067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28c9c-3f1e-417b-a893-6c64834da569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:24.017749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28c9c-3f1e-417b-a893-6c64834da569 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:24.018032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28c9c-3f1e-417b-a893-6c64834da569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:24.018331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28c9c-3f1e-417b-a893-6c64834da569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:24.028302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28c9c-3f1e-417b-a893-6c64834da569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:24.029873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28c9c-3f1e-417b-a893-6c64834da569 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:24.043293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 957/1897] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:24.126561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:24.136846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17140b5-7eac-4083-a494-a0d1d3fab25b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:24.140519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:24.141211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:24.141492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:24.141763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:24.236375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:24.239994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:24.262195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 941/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:24.849694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ce204-eaf4-4ed0-bff5-e7d185f02208 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:24.850243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ce204-eaf4-4ed0-bff5-e7d185f02208 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:24.850335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ce204-eaf4-4ed0-bff5-e7d185f02208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:24.887409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e80ce204-eaf4-4ed0-bff5-e7d185f02208 None None] MFA Rules not processed for user `aaefc46a7e6d431c9eebc5233389c61e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:24.889580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e80ce204-eaf4-4ed0-bff5-e7d185f02208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:25.039154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 958/1899] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:25.047149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:25.057801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bec10-f847-4a8c-82b9-77f3f6886b16 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:25.067417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:25.069374 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:25.070009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:25.070486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:25.096100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:25.100851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:25.124846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 942/1900] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:27.721426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739005-97d6-4239-a819-32e07d6ee092 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:27.721897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739005-97d6-4239-a819-32e07d6ee092 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:27.722023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739005-97d6-4239-a819-32e07d6ee092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:27.739774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5c739005-97d6-4239-a819-32e07d6ee092 None None] MFA Rules not processed for user `aaefc46a7e6d431c9eebc5233389c61e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:27.740958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5c739005-97d6-4239-a819-32e07d6ee092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:27.748033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 959/1901] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:33.564261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:33.567205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:33.594144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290aca-390d-4b60-afc1-ebe2bea36f24 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:33.603344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:33.603344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:33.603344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:33.603344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] PATH_INFO: `/v3/users/96fd8dc4485944168e1d3c24edf5bdc7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:33.603749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fd8dc4485944168e1d3c24edf5bdc7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:33.603749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:33.677674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fd8dc4485944168e1d3c24edf5bdc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:33.678566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fd8dc4485944168e1d3c24edf5bdc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:33.679524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fd8dc4485944168e1d3c24edf5bdc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:33.689288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fd8dc4485944168e1d3c24edf5bdc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:33.720760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fd8dc4485944168e1d3c24edf5bdc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:33.774702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 943/1902] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:33 2022] DELETE /identity/v3/users/96fd8dc4485944168e1d3c24edf5bdc7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:33.779332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:33.780253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:33.780670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:33.823623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:33.826846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:33.988930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 960/1903] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:34.028028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:34.029643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:34.045191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:34.100633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456409c4-54ef-4537-8380-efd5b8bcb3c2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:34.103917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:34.106044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:34.122346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16373ad9-45ed-4b7f-8534-03a032ded571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:34.122835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16373ad9-45ed-4b7f-8534-03a032ded571 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:34.123121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16373ad9-45ed-4b7f-8534-03a032ded571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:34.123419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16373ad9-45ed-4b7f-8534-03a032ded571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:34.129653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2c4f-8082-40a6-83a9-cf151b5c40ca None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:34.149169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:34.150024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:34.150319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:34.150605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] PATH_INFO: `/v3/users/fc1426b280c14437a02cf2e22ce67325` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:34.152009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1426b280c14437a02cf2e22ce67325)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:34.153973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16373ad9-45ed-4b7f-8534-03a032ded571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:34.154105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:34.156082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16373ad9-45ed-4b7f-8534-03a032ded571 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:34.176228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 944/1904] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:34.244605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1426b280c14437a02cf2e22ce67325'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:34.245343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1426b280c14437a02cf2e22ce67325'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:34.245970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1426b280c14437a02cf2e22ce67325'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:34.255981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1426b280c14437a02cf2e22ce67325'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:34.262670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:34.298387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1426b280c14437a02cf2e22ce67325'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:34.320088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 961/1905] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:34 2022] DELETE /identity/v3/users/fc1426b280c14437a02cf2e22ce67325 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:34.324495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:34.324956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:34.325428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:34.344548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:34.346895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:34.416895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 945/1906] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:34.466445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:34.469139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:34.661717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9473-4586-4167-86e0-ffe250ab2296 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:34.668538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:34.669437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:34.669762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:34.670043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:34.681315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:34.682778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:34.695208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 962/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:36.122113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:36.123763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:36.139277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e436f2-8957-4bcc-be6f-5f8f4bbd6fec None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:36.146615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:36.147661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:36.147956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:36.148281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] PATH_INFO: `/v3/projects/dd0352bc319d4c1f98991c58ce43dea7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:36.149536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0352bc319d4c1f98991c58ce43dea7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:36.151478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:36.222593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0352bc319d4c1f98991c58ce43dea7', 'request_id': 'req-276cc706-61f7-4a29-af3e-2b1165002e28'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.233056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0352bc319d4c1f98991c58ce43dea7', 'request_id': 'req-276cc706-61f7-4a29-af3e-2b1165002e28'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.252815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0352bc319d4c1f98991c58ce43dea7', 'request_id': 'req-276cc706-61f7-4a29-af3e-2b1165002e28'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.270396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] The token cache is being invalidate because project dd0352bc319d4c1f98991c58ce43dea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:36.270809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.271542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.273240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 946/1908] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:36 2022] DELETE /identity/v3/projects/dd0352bc319d4c1f98991c58ce43dea7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:36.277254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:36.288060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192178fa-66a5-4d46-a188-7c4508965b6d service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:36.310103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:36.321318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:36.389920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:36.391102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:36.391651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:36.392027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] PATH_INFO: `/v3/users/5665eaf82dff4b028d5b60ca2842d697` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:36.398616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5665eaf82dff4b028d5b60ca2842d697)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:36.401146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:36.406244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:36.449072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc706-61f7-4a29-af3e-2b1165002e28 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:36.473395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:36.474558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:36.474932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:36.475294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] PATH_INFO: `/v3/projects/88b9cd2d6d11459c9c7f2cbfa201ac25` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:36.481317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b9cd2d6d11459c9c7f2cbfa201ac25)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:36.483787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:36.576089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5665eaf82dff4b028d5b60ca2842d697'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.578970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5665eaf82dff4b028d5b60ca2842d697'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.581303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5665eaf82dff4b028d5b60ca2842d697'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.599654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b9cd2d6d11459c9c7f2cbfa201ac25', 'request_id': 'req-c8de427b-3a63-422c-af1b-28cbb33034ba'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.617104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5665eaf82dff4b028d5b60ca2842d697'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.624307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b9cd2d6d11459c9c7f2cbfa201ac25', 'request_id': 'req-c8de427b-3a63-422c-af1b-28cbb33034ba'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.632293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b9cd2d6d11459c9c7f2cbfa201ac25', 'request_id': 'req-c8de427b-3a63-422c-af1b-28cbb33034ba'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.650627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5665eaf82dff4b028d5b60ca2842d697'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.653939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] The token cache is being invalidate because project 88b9cd2d6d11459c9c7f2cbfa201ac25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:36.654313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.656350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.658745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 947/1909] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:36 2022] DELETE /identity/v3/projects/88b9cd2d6d11459c9c7f2cbfa201ac25 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:36.663011 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:36.665433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:36.676472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:36.682057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 963/1910] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:36 2022] DELETE /identity/v3/users/5665eaf82dff4b028d5b60ca2842d697 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:36.821594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de427b-3a63-422c-af1b-28cbb33034ba admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:36.907307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:36.908626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:36.908916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:36.909239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] PATH_INFO: `/v3/users/9f2926c753f74a7e818c166388735b38` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:36.911154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2926c753f74a7e818c166388735b38)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:36.913173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:36.932221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:36.989892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2926c753f74a7e818c166388735b38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.990643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2926c753f74a7e818c166388735b38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:36.991323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2926c753f74a7e818c166388735b38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.000307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2926c753f74a7e818c166388735b38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.019485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2926c753f74a7e818c166388735b38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.048698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 948/1911] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:36 2022] DELETE /identity/v3/users/9f2926c753f74a7e818c166388735b38 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:37.436209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.438470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:37.453833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7260b-5279-4eda-a37a-8509c52d4fe8 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.497804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.499897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:37.522747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.523756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.524078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.524302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] PATH_INFO: `/v3/projects/2b8f23f31ae64d7fa4f8781115c4bfc9` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.525619 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8f23f31ae64d7fa4f8781115c4bfc9)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.527676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.570554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9748-8d8f-4a6d-a332-921e599874cb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.576888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8f23f31ae64d7fa4f8781115c4bfc9', 'request_id': 'req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.586805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8f23f31ae64d7fa4f8781115c4bfc9', 'request_id': 'req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.595455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8f23f31ae64d7fa4f8781115c4bfc9', 'request_id': 'req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.614474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] The token cache is being invalidate because project 2b8f23f31ae64d7fa4f8781115c4bfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:37.614791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.615466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ed8ee01d-7639-4bc2-8b1d-e777d5443f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.617895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 964/1912] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:37 2022] DELETE /identity/v3/projects/2b8f23f31ae64d7fa4f8781115c4bfc9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:37.622512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6da14-5c84-478f-9547-ac6c93b67a00 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.622812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6da14-5c84-478f-9547-ac6c93b67a00 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.623091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6da14-5c84-478f-9547-ac6c93b67a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.639367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.640423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.640763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.641227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] PATH_INFO: `/v3/projects/d35577d99d15411e9791ee866e260644` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.642722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-71b6da14-5c84-478f-9547-ac6c93b67a00 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:37.642949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35577d99d15411e9791ee866e260644)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.643853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-71b6da14-5c84-478f-9547-ac6c93b67a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:37.646591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.659297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 965/1913] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:37.667167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.667362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.668024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.687733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:37.689343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:37.704909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:37.710024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35577d99d15411e9791ee866e260644', 'request_id': 'req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.719978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35577d99d15411e9791ee866e260644', 'request_id': 'req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.727987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35577d99d15411e9791ee866e260644', 'request_id': 'req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.741683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] The token cache is being invalidate because project d35577d99d15411e9791ee866e260644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:37.741995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.742633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c4f12f7b-4834-4752-a0c2-8f8ae109b7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:37.744498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 949/1914] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:37 2022] DELETE /identity/v3/projects/d35577d99d15411e9791ee866e260644 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:37.749156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a0953-7f12-4373-be0d-f6d9823f1727 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.750188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a0953-7f12-4373-be0d-f6d9823f1727 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.750188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a0953-7f12-4373-be0d-f6d9823f1727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.769867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ea6a0953-7f12-4373-be0d-f6d9823f1727 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:37.771078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ea6a0953-7f12-4373-be0d-f6d9823f1727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:37.777878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 966/1915] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:37.781873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.782066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 950/1916] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:37.789504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.789788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.790061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.791486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcbb3e-4d06-4967-ba74-21057d9b3b28 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.795977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.796757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.797072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.797359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.798092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:37.798407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.800016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.807978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:37.809202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:37.812172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 967/1917] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:12:37.816515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.817664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 951/1918] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:37.821570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.826844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feead2-5872-4c93-beae-e1e0885430c5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.830502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d0a4d-e79f-4729-bf45-1049b055eb32 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.832518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.833224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.833507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.833778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.834472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.835160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.835850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.836134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.836405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.836499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.837179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:37.837484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.839065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.845879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:37.851829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 952/1919] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:12:37.856892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.866220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 968/1920] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:37.867634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5505c-90d8-42a9-822c-a35541cc959f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.870096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.938107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.938696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.938977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.939246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.939534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7934da8-c81a-4da9-9bce-a408b74c0ca0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:37.939949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.941898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.946195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:37.946976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:37.947262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:37.947540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:37.948324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:37.950306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:37.971221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 953/1921] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:37.975473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.978456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 969/1922] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:37.982270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:37.992654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dec83-7560-4a9a-aee5-1c731e816c12 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.051707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142614-4ea0-4114-8ab3-910964e376c6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.056497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.057141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.057418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.057696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.058434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.060349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.061521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.062549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.062884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.063184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.064026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.065716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.076857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 970/1923] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:38.080776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.084107 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 954/1924] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:37 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:38.085237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.090507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab6b15-0fc2-4e31-b8c4-f1b2dae1640f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.095351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.095530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af8fc3-d32a-41f6-9e9b-24cb72c38bf3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.096071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.096351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.096625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.097378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.098999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.100607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.101303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.101587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.101891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.102625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.104211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.109248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 971/1925] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:38.113320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.117231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 955/1926] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:38.121325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.123195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952e8ea-dd1c-4b5e-8775-ada31c227154 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.129052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595fdf3-a122-460a-b1d7-7014fd3d8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.129967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595fdf3-a122-460a-b1d7-7014fd3d8b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.130250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595fdf3-a122-460a-b1d7-7014fd3d8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.130526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595fdf3-a122-460a-b1d7-7014fd3d8b88 admin admin] PATH_INFO: `/v3/projects/6e57ef4d6c3e4243b8dcc59a2897f6d0/users/65ded6dfe2744479a4a9a77eecdcc8c2/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.131555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dbc3e-3f18-4992-88e5-9c3c71e4dfce admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.136195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.136843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.137172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.137444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.138164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.140295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.142928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.146168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595fdf3-a122-460a-b1d7-7014fd3d8b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e57ef4d6c3e4243b8dcc59a2897f6d0, user_id=65ded6dfe2744479a4a9a77eecdcc8c2, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.148846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595fdf3-a122-460a-b1d7-7014fd3d8b88 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.157070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 956/1927] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:38.157984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.163979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 972/1928] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:38 2022] PUT /identity/v3/projects/6e57ef4d6c3e4243b8dcc59a2897f6d0/users/65ded6dfe2744479a4a9a77eecdcc8c2/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:38.168928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68882c-006d-4b6a-8804-2a2968627777 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.174198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.174486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.174762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.202381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] MFA Rules not processed for user `65ded6dfe2744479a4a9a77eecdcc8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:38.203582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:38.232697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804efc-4920-4639-9d17-41b9cd3cb37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.233915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804efc-4920-4639-9d17-41b9cd3cb37b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.234377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804efc-4920-4639-9d17-41b9cd3cb37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.234658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.234750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804efc-4920-4639-9d17-41b9cd3cb37b admin admin] PATH_INFO: `/v3/projects/27a905e9adbd46c4b32c43ef2fc02615/users/31122d9abd6a466c81b2ed4ac1ff5845/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.253135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66804efc-4920-4639-9d17-41b9cd3cb37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a905e9adbd46c4b32c43ef2fc02615, user_id=31122d9abd6a466c81b2ed4ac1ff5845, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.256088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66804efc-4920-4639-9d17-41b9cd3cb37b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.283781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 957/1929] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:38 2022] PUT /identity/v3/projects/27a905e9adbd46c4b32c43ef2fc02615/users/31122d9abd6a466c81b2ed4ac1ff5845/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:38.283979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 973/1930] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:38.286596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.286895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.287265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.295780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.298538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:38.331736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] MFA Rules not processed for user `31122d9abd6a466c81b2ed4ac1ff5845`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:38.333609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:38.377976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353a84f-f694-4939-9ae1-c8c6f62e4181 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.423310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 958/1931] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:38.427650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.453808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.454530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.454823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.455158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.516955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9fe70-db45-40ee-8c4b-10f175466de0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.522467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.524080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.524194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.524643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.525180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.525613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.526642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.529342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.534990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 974/1932] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:38.554159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.555082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.568341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe29e2-9c6b-42f9-bba2-53aa176397e9 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.574198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.575359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.575473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.575677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] PATH_INFO: `/v3/users/65ded6dfe2744479a4a9a77eecdcc8c2` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.577129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ded6dfe2744479a4a9a77eecdcc8c2)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.579546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.585166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 959/1933] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:38 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:38.588596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.637483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.648270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ded6dfe2744479a4a9a77eecdcc8c2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:38.649122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ded6dfe2744479a4a9a77eecdcc8c2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:38.649804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ded6dfe2744479a4a9a77eecdcc8c2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:38.657477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ded6dfe2744479a4a9a77eecdcc8c2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:38.664949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b58a1-adc5-485d-837e-3a5b6fb605fd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.669510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b3871d21-95ae-41d8-a063-02bd1ac184b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ded6dfe2744479a4a9a77eecdcc8c2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:38.669929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.670613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.670874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.671142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.671961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.673977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.683663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 975/1934] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:38 2022] DELETE /identity/v3/users/65ded6dfe2744479a4a9a77eecdcc8c2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:38.689104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.689404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.689812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.695307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 960/1935] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:38 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:38.698646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.700429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:38.709910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:38.711033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:38.712378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe490dd-ec53-4269-8c8f-ac20f1843298 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.770893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.771586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.771870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.772200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.772890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.774350 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 976/1936] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:38.774609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.784753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.787241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:38.791561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 961/1937] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:38.796181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.807912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa177e-257c-4f55-bb8e-b4886eea6054 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.813963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.814994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.815284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.815692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] PATH_INFO: `/v3/projects/10d324f6641d4ab5b06b68a64e04a2d7/users/ef09a68aee5f4ff98d61a92f1ca99f13/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.833499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d324f6641d4ab5b06b68a64e04a2d7, user_id=ef09a68aee5f4ff98d61a92f1ca99f13, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.836239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.847061 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56edb9-803a-4431-b35b-1e4771517116 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.855643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 962/1938] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:38 2022] PUT /identity/v3/projects/10d324f6641d4ab5b06b68a64e04a2d7/users/ef09a68aee5f4ff98d61a92f1ca99f13/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:38.859726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.908037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74d42-cb61-4e91-b276-2ffab10afcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.908714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74d42-cb61-4e91-b276-2ffab10afcda service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.908998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74d42-cb61-4e91-b276-2ffab10afcda service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.909304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74d42-cb61-4e91-b276-2ffab10afcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.928627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.932473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.934002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13bf1b-536c-46c7-853c-86f7472ca2c2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.940714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.941573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.941842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.942124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.943075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.944887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.961124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 963/1939] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:38.962995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:38.972927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196911d-11e6-4038-85f3-44370eead518 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:38.977534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:38.978439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:38.978714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:38.978983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] PATH_INFO: `/v3/projects/10d324f6641d4ab5b06b68a64e04a2d7/users/ef09a68aee5f4ff98d61a92f1ca99f13/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:38.979079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c74d42-cb61-4e91-b276-2ffab10afcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.980497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c74d42-cb61-4e91-b276-2ffab10afcda service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.980965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d324f6641d4ab5b06b68a64e04a2d7, user_id=ef09a68aee5f4ff98d61a92f1ca99f13, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:38.983963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:38.990124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 977/1940] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:38.994572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 964/1941] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:38 2022] PUT /identity/v3/projects/10d324f6641d4ab5b06b68a64e04a2d7/users/ef09a68aee5f4ff98d61a92f1ca99f13/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:39.006044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.006406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.006734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.033412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] MFA Rules not processed for user `ef09a68aee5f4ff98d61a92f1ca99f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:39.034634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.113632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 978/1942] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:39.124591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.126668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.199816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df490a-2c3a-419c-8dd1-dd6a141614f4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:39.203719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:39.205056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.205056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.205223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.219061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:39.220682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:39.231632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 965/1943] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:39.309400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.311132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.389589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.418317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1ce9-1d65-41bb-ad1c-8712b77a02ca None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:39.425628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:39.426751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.427031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.427341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] PATH_INFO: `/v3/projects/6e57ef4d6c3e4243b8dcc59a2897f6d0` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.428764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e57ef4d6c3e4243b8dcc59a2897f6d0)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:39.431072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:39.500640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0773c-24bc-4a79-9f05-93e9165c189d service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:39.513813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:39.515367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.516127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.516636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] PATH_INFO: `/v3/users/31122d9abd6a466c81b2ed4ac1ff5845` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.518375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31122d9abd6a466c81b2ed4ac1ff5845)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:39.521216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:39.532263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:39.540230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e57ef4d6c3e4243b8dcc59a2897f6d0', 'request_id': 'req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.563807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e57ef4d6c3e4243b8dcc59a2897f6d0', 'request_id': 'req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.576865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e57ef4d6c3e4243b8dcc59a2897f6d0', 'request_id': 'req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.599797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31122d9abd6a466c81b2ed4ac1ff5845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.601422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31122d9abd6a466c81b2ed4ac1ff5845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.602427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31122d9abd6a466c81b2ed4ac1ff5845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.609035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] The token cache is being invalidate because project 6e57ef4d6c3e4243b8dcc59a2897f6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:39.609035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.611180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-917b9a1b-02f0-4e8e-9f00-32a5308b8e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.617695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 979/1944] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:39 2022] DELETE /identity/v3/projects/6e57ef4d6c3e4243b8dcc59a2897f6d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:39.619608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a70e7d-f4ec-4b4d-aa65-880546b5dc13 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.619903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a70e7d-f4ec-4b4d-aa65-880546b5dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.620361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a70e7d-f4ec-4b4d-aa65-880546b5dc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.622122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31122d9abd6a466c81b2ed4ac1ff5845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.636998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b63404f2-980b-4c9f-a88d-f0cd779e4c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31122d9abd6a466c81b2ed4ac1ff5845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:39.644760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-89a70e7d-f4ec-4b4d-aa65-880546b5dc13 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:39.646096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-89a70e7d-f4ec-4b4d-aa65-880546b5dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.657758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 966/1945] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:39 2022] DELETE /identity/v3/users/31122d9abd6a466c81b2ed4ac1ff5845 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:39.660197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.660693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.661246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.668489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:39.685629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:39.688203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.721422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 980/1946] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:39.733393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.733393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.733393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.761087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:39.762651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.775288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 967/1947] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:39.826392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.828347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:39.847797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 981/1948] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:39.853236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.864994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27bad6-bcf4-4e4c-948d-bcca91992023 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:39.870910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:39.871922 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.872401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.873323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.879812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:39.880843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:39.882903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:39.904146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8801df-63b6-4d5c-8b7b-776841773daa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:39.911020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 982/1949] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:39.912443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.914474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:39.915459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.915459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.915751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.926945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cc3f-d2b1-4101-83f2-46008ed93130 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:39.928074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:39.929663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:39.934679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:39.935840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:39.936567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:39.937313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:39.938272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:39.941376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:39.945279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 968/1950] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:39.983269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 983/1951] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:39 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:39.985623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:39.995392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc0a36-4111-4ad1-85a7-e2c68a691527 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:40.058659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:40.059091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:40.060235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:40.061071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:40.061662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:40.063826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:40.097099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 969/1952] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:39 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:40.101337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:40.115846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b1b5-cefb-47c6-a5a7-b3d715fc886c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:40.153635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:40.154509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:40.154889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:40.155266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:40.156153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:40.159167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:40.176819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 984/1953] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:40.178473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:40.190816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf8749-6cce-4964-a337-45fbac355eec admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:40.195734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5eb7bb-fa1f-4f78-b8d2-f10d2b543242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:40.196975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eb7bb-fa1f-4f78-b8d2-f10d2b543242 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:40.196975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eb7bb-fa1f-4f78-b8d2-f10d2b543242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:40.197356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eb7bb-fa1f-4f78-b8d2-f10d2b543242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:40.198236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5eb7bb-fa1f-4f78-b8d2-f10d2b543242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:40.200095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5eb7bb-fa1f-4f78-b8d2-f10d2b543242 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:40.220261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 970/1954] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:40.220461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:40.232313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490a04-a083-4d24-be97-2c4d66713fcc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:40.238302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:40.239625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:40.239962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:40.240240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] PATH_INFO: `/v3/projects/e8783f8ed20141d09ba50585f0a3ce76/users/0da39d941803485b99e214d12444b98b/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:40.271483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8783f8ed20141d09ba50585f0a3ce76, user_id=0da39d941803485b99e214d12444b98b, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:40.275063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:40.290318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 985/1955] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:40 2022] PUT /identity/v3/projects/e8783f8ed20141d09ba50585f0a3ce76/users/0da39d941803485b99e214d12444b98b/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:40.300365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:40.300746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:40.301116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:40.337053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] MFA Rules not processed for user `0da39d941803485b99e214d12444b98b`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:40.338654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:40.354281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:40.431810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 971/1956] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:40.444291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:40.446064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:40.454388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:40.576470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d14e58-f229-494e-8a69-c80f9d767572 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:40.590008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:40.590800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:40.591096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:40.591378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:40.620261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:40.622430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:40.648774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 986/1957] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:41.624842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:41.627319 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:41.734317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659690c9-fbdc-4d9d-a97a-23a2a0110b64 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:41.738799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:41.739686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:41.739966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:41.740240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] PATH_INFO: `/v3/projects/27a905e9adbd46c4b32c43ef2fc02615` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:41.741519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a905e9adbd46c4b32c43ef2fc02615)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:41.743469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:41.805170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a905e9adbd46c4b32c43ef2fc02615', 'request_id': 'req-5ece0931-161e-4a99-ac3c-836973bf78e1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:41.815018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a905e9adbd46c4b32c43ef2fc02615', 'request_id': 'req-5ece0931-161e-4a99-ac3c-836973bf78e1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:41.821478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a905e9adbd46c4b32c43ef2fc02615', 'request_id': 'req-5ece0931-161e-4a99-ac3c-836973bf78e1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:41.836203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] The token cache is being invalidate because project 27a905e9adbd46c4b32c43ef2fc02615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:41.836522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:41.837338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5ece0931-161e-4a99-ac3c-836973bf78e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:41.841919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 972/1958] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:41 2022] DELETE /identity/v3/projects/27a905e9adbd46c4b32c43ef2fc02615 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:41.844374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:41.851521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d73b68-3659-4ec3-b39a-8103cd06fc94 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:41.851802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d73b68-3659-4ec3-b39a-8103cd06fc94 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:41.852070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d73b68-3659-4ec3-b39a-8103cd06fc94 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:41.858793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 973/1959] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:12:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:12:41.860150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219712-0aaa-451f-b6ff-57899ebc7519 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:41.870015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:41.870564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:41.870907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:41.903743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:41.905287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:41.985203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:42.001891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:42.003720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:42.004173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:42.004614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] PATH_INFO: `/v3/users/ef09a68aee5f4ff98d61a92f1ca99f13` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:42.006668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef09a68aee5f4ff98d61a92f1ca99f13)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:42.009700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:42.087002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef09a68aee5f4ff98d61a92f1ca99f13'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:42.087853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef09a68aee5f4ff98d61a92f1ca99f13'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:42.088683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef09a68aee5f4ff98d61a92f1ca99f13'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:42.099076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef09a68aee5f4ff98d61a92f1ca99f13'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:42.107451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 974/1960] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:42.130183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:42.131834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:42.165664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e0b13489-368e-4fc3-aa3d-43d13db05cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef09a68aee5f4ff98d61a92f1ca99f13'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:42.173986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457b333-d5e4-4880-93b0-f3a667ee60cd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:42.188794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:42.189273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:42.189570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:42.189856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:42.196139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:42.212008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 987/1961] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:41 2022] DELETE /identity/v3/users/ef09a68aee5f4ff98d61a92f1ca99f13 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:42.232379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:42.234177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e4236-df97-4cc7-a39d-46bef3517139 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:42.257863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 975/1962] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:42.489814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522c7a-7551-4d7d-85dc-23daa6157130 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:42.490251 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522c7a-7551-4d7d-85dc-23daa6157130 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:42.490602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522c7a-7551-4d7d-85dc-23daa6157130 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:42.492468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 988/1963] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:12:42.522578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:42.522971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:42.523940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:42.558535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:42.560405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:42.727793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 976/1964] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:43.101663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522c7a-7551-4d7d-85dc-23daa6157130 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.104510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-17522c7a-7551-4d7d-85dc-23daa6157130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:43.127934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522c7a-7551-4d7d-85dc-23daa6157130 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.136345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d8a00-9f84-4d9d-b646-f8d211188e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.137611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8a00-9f84-4d9d-b646-f8d211188e86 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.137897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8a00-9f84-4d9d-b646-f8d211188e86 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.138173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8a00-9f84-4d9d-b646-f8d211188e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.151595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d8a00-9f84-4d9d-b646-f8d211188e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.153621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d8a00-9f84-4d9d-b646-f8d211188e86 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.170491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 989/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:43.176581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.178396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:43.264601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e317b-7201-46e5-9aee-43cb2c639e89 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.269593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.270548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.270831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.271100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] PATH_INFO: `/v3/projects/10d324f6641d4ab5b06b68a64e04a2d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.272303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d324f6641d4ab5b06b68a64e04a2d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.274381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.328919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d324f6641d4ab5b06b68a64e04a2d7', 'request_id': 'req-64febd05-bea1-4b29-9fc0-00905960ca1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:43.339337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d324f6641d4ab5b06b68a64e04a2d7', 'request_id': 'req-64febd05-bea1-4b29-9fc0-00905960ca1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:43.340898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:43.346799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d324f6641d4ab5b06b68a64e04a2d7', 'request_id': 'req-64febd05-bea1-4b29-9fc0-00905960ca1d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:43.359717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] The token cache is being invalidate because project 10d324f6641d4ab5b06b68a64e04a2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:43.360038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:43.360744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64febd05-bea1-4b29-9fc0-00905960ca1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:43.362375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 977/1966] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:43 2022] DELETE /identity/v3/projects/10d324f6641d4ab5b06b68a64e04a2d7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:43.367586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.368101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.368384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.388183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:43.389423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:43.399708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:43.458188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 990/1967] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:43.466995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.467313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.467591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.487229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:43.488435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:43.496795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 978/1968] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:43.501541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.511142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5271-3c77-4709-8300-5f22117c1b0d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.515672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.516338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.516618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.516893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.517665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:43.517974 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.519571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.535687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 991/1969] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:43.536673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.546219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0315ef-ae30-4e01-9024-006511dded6c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.551169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.551843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.552128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.552403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.553214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.555117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.582893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 979/1970] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:43 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:43.587111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.597120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967e19-6f10-4993-b689-adb01a57d2b5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.653567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.654255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.654623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.654785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.655491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.657822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.680022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 992/1971] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:43 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:43.684151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.694709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a9af-a00e-4a67-ae4a-17172aa751c9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.699534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.700244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.700511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.700785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.701575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.703405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.713719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 980/1972] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:43.719472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.734583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a4b86-d9fe-40f8-aac0-fb9483869f7b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.739539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029bd2-072c-42d9-bf15-2a7c51cba90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.740228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029bd2-072c-42d9-bf15-2a7c51cba90e admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.740506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029bd2-072c-42d9-bf15-2a7c51cba90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.740774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029bd2-072c-42d9-bf15-2a7c51cba90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.741532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029bd2-072c-42d9-bf15-2a7c51cba90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.743150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029bd2-072c-42d9-bf15-2a7c51cba90e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.753654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 993/1973] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:43.757981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.768536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3c615-98f3-4157-a498-3c831ff38885 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.774167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.775075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.775363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.775632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] PATH_INFO: `/v3/projects/682779d22f9748d38fbeccd4c50c8bd7/users/8d5ec4edbcc04ebab15b9f656ef921a8/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.793427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=682779d22f9748d38fbeccd4c50c8bd7, user_id=8d5ec4edbcc04ebab15b9f656ef921a8, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:43.796472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:43.812857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 981/1974] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:43 2022] PUT /identity/v3/projects/682779d22f9748d38fbeccd4c50c8bd7/users/8d5ec4edbcc04ebab15b9f656ef921a8/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:43.823457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.823742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.824017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:43.851480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] MFA Rules not processed for user `8d5ec4edbcc04ebab15b9f656ef921a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:43.852614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:43.920526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 994/1975] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:43.931706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:43.933686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:43.992298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d1ed-24ff-4efb-8743-912ad323f5ad admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:43.996019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:43.996674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:43.996959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:43.997265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:44.006655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:44.008082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:44.017413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 982/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:53.917369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:54.012933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:54.388894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:54.390392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:54.467696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c3fe-cb53-46ac-911c-01e3d3551e13 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:54.472869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:54.473787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:54.474095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:54.474374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] PATH_INFO: `/v3/users/db1129cd3fbb45129e3de45385e5aa24` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:54.475632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1129cd3fbb45129e3de45385e5aa24)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:54.477686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:54.504021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:54.525627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478a08e-aaf2-4139-a1e9-faa4d52dabf1 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:54.530327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:54.531223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:54.531531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:54.531783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] PATH_INFO: `/v3/users/8d5ec4edbcc04ebab15b9f656ef921a8` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:54.533098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5ec4edbcc04ebab15b9f656ef921a8)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:54.533677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1129cd3fbb45129e3de45385e5aa24'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.534447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1129cd3fbb45129e3de45385e5aa24'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.535130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:54.535252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1129cd3fbb45129e3de45385e5aa24'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.544175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1129cd3fbb45129e3de45385e5aa24'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.562002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4cefbf72-c338-4d36-bde7-8bcef1e728d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1129cd3fbb45129e3de45385e5aa24'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.581101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 995/1977] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:54 2022] DELETE /identity/v3/users/db1129cd3fbb45129e3de45385e5aa24 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:54.584365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:54.584566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:54.584834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:54.599580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5ec4edbcc04ebab15b9f656ef921a8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.600337 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5ec4edbcc04ebab15b9f656ef921a8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.601041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5ec4edbcc04ebab15b9f656ef921a8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.609077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:54.609077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:54.615572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5ec4edbcc04ebab15b9f656ef921a8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.629548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c5be9fca-ee6f-4549-b568-2e1f9557c4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5ec4edbcc04ebab15b9f656ef921a8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:54.649105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 983/1978] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:54 2022] DELETE /identity/v3/users/8d5ec4edbcc04ebab15b9f656ef921a8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:54.653874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:54.654237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:54.654493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:54.673830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:54.675052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:54.676948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 996/1979] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:54.689967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:54.691499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:54.712840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:54.740556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 984/1980] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:54.750153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:54.750356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8962655-3b98-484c-a749-b8745b384ba2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:54.800789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:54.801446 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:54.801727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:54.801999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:54.806918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b7b76-1623-47ea-af41-99e09c7b3363 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:54.810725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:54.811366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:54.811652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:54.811945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:54.812347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:54.814253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:54.822022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:54.823470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:54.824223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 997/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:54.833264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 985/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:12:55.461876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:55.463859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:55.483044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:55.483481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb02e-81f7-4e89-83e0-4bb4e3270354 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:55.484545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:55.489186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:55.490250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.490806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.491196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] PATH_INFO: `/v3/projects/682779d22f9748d38fbeccd4c50c8bd7` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.493299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] RBAC: Authorizing `identity:delete_project(project_id=682779d22f9748d38fbeccd4c50c8bd7)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:55.495577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:55.508361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a891-2588-4e30-83db-11df66e9db5e service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:55.538163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:55.539572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.540038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.543530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] PATH_INFO: `/v3/projects/f6cac04257d64ca4991b38d5d90ff1e6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.549201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cac04257d64ca4991b38d5d90ff1e6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:55.551344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:55.564595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:55.597481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682779d22f9748d38fbeccd4c50c8bd7', 'request_id': 'req-dc5bef14-81c3-4c06-8ea0-3063ef09346b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.614486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682779d22f9748d38fbeccd4c50c8bd7', 'request_id': 'req-dc5bef14-81c3-4c06-8ea0-3063ef09346b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.621721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682779d22f9748d38fbeccd4c50c8bd7', 'request_id': 'req-dc5bef14-81c3-4c06-8ea0-3063ef09346b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.634752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] The token cache is being invalidate because project 682779d22f9748d38fbeccd4c50c8bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:55.635026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.635789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-dc5bef14-81c3-4c06-8ea0-3063ef09346b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.636231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cac04257d64ca4991b38d5d90ff1e6', 'request_id': 'req-f71070e4-3fd7-40aa-9a82-35e714184076'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.637736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 998/1983] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:55 2022] DELETE /identity/v3/projects/682779d22f9748d38fbeccd4c50c8bd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:55.642722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815268ae-2a67-47c3-86a2-d6da73171ef4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.643136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815268ae-2a67-47c3-86a2-d6da73171ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.643518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815268ae-2a67-47c3-86a2-d6da73171ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.646855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cac04257d64ca4991b38d5d90ff1e6', 'request_id': 'req-f71070e4-3fd7-40aa-9a82-35e714184076'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.655068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cac04257d64ca4991b38d5d90ff1e6', 'request_id': 'req-f71070e4-3fd7-40aa-9a82-35e714184076'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.662614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-815268ae-2a67-47c3-86a2-d6da73171ef4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:55.663943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-815268ae-2a67-47c3-86a2-d6da73171ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:55.667509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] The token cache is being invalidate because project f6cac04257d64ca4991b38d5d90ff1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:55.667798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.668443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.670290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 986/1984] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:55 2022] DELETE /identity/v3/projects/f6cac04257d64ca4991b38d5d90ff1e6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:55.674063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:55.675396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:55.745421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71070e4-3fd7-40aa-9a82-35e714184076 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:55.753528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:55.754452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.754838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.755318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] PATH_INFO: `/v3/users/fde7019918c5455ea344ed5d82077fc3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.756807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde7019918c5455ea344ed5d82077fc3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:55.758857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:55.765234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 999/1985] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:55.773855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.774184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.774465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.783048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:55.807227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:55.808384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:55.819581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1000/1986] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:55.824267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:55.837677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeebf4-415c-4224-823e-8153493ac87a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:55.843300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:55.843969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.844298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.844676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.845577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:55.845885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:55.847581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:55.871175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde7019918c5455ea344ed5d82077fc3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.871706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1001/1987] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:12:55.873616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:55.873914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde7019918c5455ea344ed5d82077fc3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.875405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde7019918c5455ea344ed5d82077fc3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.877215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:55.895471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde7019918c5455ea344ed5d82077fc3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.914573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16850-6e56-424d-895d-9ae28c5737a2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:55.922653 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:55.923544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:55.924003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:55.924131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde7019918c5455ea344ed5d82077fc3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:55.924579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:55.925521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:55.927652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:55.946473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 987/1988] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:12:55 2022] DELETE /identity/v3/users/fde7019918c5455ea344ed5d82077fc3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:55.980041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1002/1989] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:55 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:55.981707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.011141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:56.082102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813a1a7-67cf-43e4-92c1-79e129b5c1af admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.148603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.149353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.149640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.149924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.150636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.152578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.175485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 988/1990] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:55 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:56.179777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.190286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b949-4d2d-4fd9-931e-2dadbec45565 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.194973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.195646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.195928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.196202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.196939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.198586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.208911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1003/1991] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:56.214577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.227533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3148-253e-4117-8a41-4c896ae136f3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.232743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.233381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.233669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.233949 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.234694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.236471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.248096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 989/1992] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:56.253245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.264639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2766b3-b3fb-450e-8870-8606be6b0377 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.270368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fd5f1-088f-419c-87e7-61e7bb0a8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.271282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fd5f1-088f-419c-87e7-61e7bb0a8b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.271569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fd5f1-088f-419c-87e7-61e7bb0a8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.271851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fd5f1-088f-419c-87e7-61e7bb0a8b57 admin admin] PATH_INFO: `/v3/projects/0ab94ae3023741ad8f63b325dae9cf54/users/508896029b5041f0801eec048821c491/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.281980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.284519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:56.290315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fd5f1-088f-419c-87e7-61e7bb0a8b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab94ae3023741ad8f63b325dae9cf54, user_id=508896029b5041f0801eec048821c491, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.292977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fd5f1-088f-419c-87e7-61e7bb0a8b57 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.298019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d173d-51a3-450a-b9a3-c474c82f2940 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.304554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.306240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.306534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.306974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] PATH_INFO: `/v3/projects/f488874646414cc1b6192c97dfa9c449` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.308361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f488874646414cc1b6192c97dfa9c449)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.309672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1004/1993] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:56 2022] PUT /identity/v3/projects/0ab94ae3023741ad8f63b325dae9cf54/users/508896029b5041f0801eec048821c491/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:56.310479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.320566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.320863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.321181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.356143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] MFA Rules not processed for user `508896029b5041f0801eec048821c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:56.357576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:56.403728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f488874646414cc1b6192c97dfa9c449', 'request_id': 'req-2d4883dd-48d2-4109-9d3e-1532f3242d9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:56.421343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f488874646414cc1b6192c97dfa9c449', 'request_id': 'req-2d4883dd-48d2-4109-9d3e-1532f3242d9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:56.430675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f488874646414cc1b6192c97dfa9c449', 'request_id': 'req-2d4883dd-48d2-4109-9d3e-1532f3242d9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:56.448067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] The token cache is being invalidate because project f488874646414cc1b6192c97dfa9c449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:12:56.448408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:56.449117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2d4883dd-48d2-4109-9d3e-1532f3242d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:12:56.450877 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 990/1994] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:12:56 2022] DELETE /identity/v3/projects/f488874646414cc1b6192c97dfa9c449 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:56.455769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1005/1995] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:56.457096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f27388-b239-4b90-8d4b-dcd131e7a630 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.457450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f27388-b239-4b90-8d4b-dcd131e7a630 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.457804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f27388-b239-4b90-8d4b-dcd131e7a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.459369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.489262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-22f27388-b239-4b90-8d4b-dcd131e7a630 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:56.491244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-22f27388-b239-4b90-8d4b-dcd131e7a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:56.524707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:56.544036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68655e5-8a9e-4c13-9952-49bcb4cf9431 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.566610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:56.566841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 991/1996] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:56.575926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.576191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.576478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.596485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:56.598531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:56.617848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 992/1997] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:56.620226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.635454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406b62c-09e1-4466-ab79-db29f9cb0ac3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.639407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.641130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.641310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.642045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.642354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.642634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.643250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.643250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.644089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:12:56.644491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.644866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.647028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.648947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.663593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 993/1998] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:12:56.668178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.680431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c804b58-e719-4f24-80b7-2742d66e9ccf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.694532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.694532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.694532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.694532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.694953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.694953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.724705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 994/1999] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:56.729263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1006/2000] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:56.729773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.733387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.735719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:56.822886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a1bca-87d5-4c66-bb4f-496f9993c311 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.827577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.828256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.828537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.828868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.829173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4ab9-e65d-42aa-ade7-8d6d65d1d429 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.829605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.831669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.834117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20676-a316-42d1-9597-371321036897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.834832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20676-a316-42d1-9597-371321036897 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.835111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20676-a316-42d1-9597-371321036897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.835383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20676-a316-42d1-9597-371321036897 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.836078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb20676-a316-42d1-9597-371321036897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.838030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb20676-a316-42d1-9597-371321036897 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.855020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 995/2001] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:56.859089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1007/2002] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:56.859222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.862778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20676-a316-42d1-9597-371321036897 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.869092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d65a-bacc-496a-8bf7-42617d892c18 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.872229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20676-a316-42d1-9597-371321036897 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.873619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.874283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.874564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.874835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.876641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.877128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.877775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.878054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.878273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.878378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.879153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.880728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.892013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 996/2003] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:56.892205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1008/2004] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:56.894343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.894486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.903928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48a99-7b3f-4026-9d73-8aa32170b66a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.905283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4aa0-ca65-42ba-9b47-183dd2762810 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.908553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.909229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.909530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.909783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.910501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.911176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.911842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.912076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.912206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.912381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.914486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.914921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.926458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 997/2005] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:56.927365 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1009/2006] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:56.930839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.932075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:56.941642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75c499-c701-4045-b113-5dc97fd5df5d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.942087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a517-08dc-46e3-ab32-5573d20dbfef admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:56.946565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ee6e-df73-4445-a7f9-646a80a9f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.947472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ee6e-df73-4445-a7f9-646a80a9f370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.947735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0232-94ed-421a-8640-f52522fd311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:56.947866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ee6e-df73-4445-a7f9-646a80a9f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.948040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ee6e-df73-4445-a7f9-646a80a9f370 admin admin] PATH_INFO: `/v3/projects/069150fbdbe044ceaab22b9252a676c7/users/d81adde90f184c2fb391b263cda98441/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.948626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0232-94ed-421a-8640-f52522fd311e admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:56.948910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0232-94ed-421a-8640-f52522fd311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:56.949223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0232-94ed-421a-8640-f52522fd311e admin admin] PATH_INFO: `/v3/projects/a8e9fce847f4474fbbc003d999083458/users/4f854adfe64149f0a4661c5a8b1fb4a0/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:56.963964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ee6e-df73-4445-a7f9-646a80a9f370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069150fbdbe044ceaab22b9252a676c7, user_id=d81adde90f184c2fb391b263cda98441, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.966431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0232-94ed-421a-8640-f52522fd311e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e9fce847f4474fbbc003d999083458, user_id=4f854adfe64149f0a4661c5a8b1fb4a0, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:56.966847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ee6e-df73-4445-a7f9-646a80a9f370 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.969128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0232-94ed-421a-8640-f52522fd311e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:56.983637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 998/2007] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:56 2022] PUT /identity/v3/projects/069150fbdbe044ceaab22b9252a676c7/users/d81adde90f184c2fb391b263cda98441/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:56.997103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1010/2008] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:56 2022] PUT /identity/v3/projects/a8e9fce847f4474fbbc003d999083458/users/4f854adfe64149f0a4661c5a8b1fb4a0/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:57.002694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.003034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.003140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.003329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.003752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.004042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.036689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] MFA Rules not processed for user `d81adde90f184c2fb391b263cda98441`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:57.037864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:57.054361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] MFA Rules not processed for user `4f854adfe64149f0a4661c5a8b1fb4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:57.055753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:57.061618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:57.105919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:57.133382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 999/2009] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:57.134484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.145968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1011/2010] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:12:57.150598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.218507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cb017-135e-445b-9f86-0893610abbd0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.222242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.223110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.223694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.223808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee037485-93b1-414d-b2d7-cdcb44ec2a18 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.223890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.224785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.226744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.228506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.229260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.229602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.229951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.230772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.232766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.254616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1000/2011] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:57.258876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.262091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1012/2012] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:57.266430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.378008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37bafe-8e7b-4cbb-9fbb-b5e4fd985c1b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.385266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.386054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.386379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.386697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.387655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.390205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.406980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9a44-7c47-476b-a61c-9f009490db6a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.420387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.421270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.421554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.421830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.423259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.424610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1013/2013] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:57.428848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.429135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.442685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9b292-a31a-49c6-aa7b-5dfecaefd3ca admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.448967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.450143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.450907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.451391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.453052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.456007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.475529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1014/2014] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:57.477259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.479274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1001/2015] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:12:57.484098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.492314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36de7c7-1624-4f23-ad0d-4598531b8ad6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.497668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.497847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5baaa-4a33-4d26-8cda-de1bb54e8d40 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.498578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.498891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.499129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] PATH_INFO: `/v3/projects/2a3d995ae11f4ed1b52b4f3eb9f9caa3/users/879d5e358dd84aa5b06616f80ec108a1/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.504163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.504864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.505189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.505469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.506237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.507864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.518853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3d995ae11f4ed1b52b4f3eb9f9caa3, user_id=879d5e358dd84aa5b06616f80ec108a1, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.521564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.522734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1002/2016] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:57.523545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.535734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd40cd-bff9-4be1-9b3c-b04fca060976 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.549554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1015/2017] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:57 2022] PUT /identity/v3/projects/2a3d995ae11f4ed1b52b4f3eb9f9caa3/users/879d5e358dd84aa5b06616f80ec108a1/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:57.554393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.559286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:57.602865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.603475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:57.604295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.604407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.605259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.606211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.608870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.625404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1003/2018] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:57.627061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.638761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dace4e-26dd-4afa-aa1e-0d67aa0e8744 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.644250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470b07f-a757-4aa2-8f3c-08e6a6624cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.645247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470b07f-a757-4aa2-8f3c-08e6a6624cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.645705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470b07f-a757-4aa2-8f3c-08e6a6624cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.645991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470b07f-a757-4aa2-8f3c-08e6a6624cfe admin admin] PATH_INFO: `/v3/projects/8d7584e940e2405691d07383649b80af/users/9466d9c1972c45559139df97807b6ccb/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.668754 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470b07f-a757-4aa2-8f3c-08e6a6624cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7584e940e2405691d07383649b80af, user_id=9466d9c1972c45559139df97807b6ccb, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.672961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470b07f-a757-4aa2-8f3c-08e6a6624cfe admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.677622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a4ab-4cc0-4ce0-80ae-972ecbd2590d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.683743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.684577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.684710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.684978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.685771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.687454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.690061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1004/2019] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:57 2022] PUT /identity/v3/projects/8d7584e940e2405691d07383649b80af/users/9466d9c1972c45559139df97807b6ccb/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:57.700655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.700985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.701274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.722390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1016/2020] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:12:57.724570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.734183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] MFA Rules not processed for user `9466d9c1972c45559139df97807b6ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:57.735456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:57.739409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a3d43-a0e7-4a90-a272-f1960236cde1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.818759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1005/2021] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:57.822905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:57.833271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd877c0-1b7c-4665-9176-27b16a178f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.834322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd877c0-1b7c-4665-9176-27b16a178f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.834668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd877c0-1b7c-4665-9176-27b16a178f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.835562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd877c0-1b7c-4665-9176-27b16a178f8f admin admin] PATH_INFO: `/v3/projects/2a3d995ae11f4ed1b52b4f3eb9f9caa3/users/879d5e358dd84aa5b06616f80ec108a1/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.837223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd877c0-1b7c-4665-9176-27b16a178f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3d995ae11f4ed1b52b4f3eb9f9caa3, user_id=879d5e358dd84aa5b06616f80ec108a1, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.840026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd877c0-1b7c-4665-9176-27b16a178f8f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:57.851212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1017/2022] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:57 2022] PUT /identity/v3/projects/2a3d995ae11f4ed1b52b4f3eb9f9caa3/users/879d5e358dd84aa5b06616f80ec108a1/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:57.862203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.862598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.862951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.895392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] MFA Rules not processed for user `879d5e358dd84aa5b06616f80ec108a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:57.896621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:57.906935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2315c61-31aa-481d-a1b5-d6177061194a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:57.959545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:57.987616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1018/2023] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:57.990868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:57.991799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:57.992096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:57.992373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:57.993114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:57.995150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.000132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.002364 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:58.025764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1006/2024] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:12:57 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:58.029692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.054185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:58.078133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2dd5c-15b8-46bf-aec2-c87080bfabea None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.104174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671e07-7283-4e29-a812-82c733946e0a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.110413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.111105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.111420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.111699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.112463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.114440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.128157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.128896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.129250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.129845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.131807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:58.141465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1007/2025] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:12:58 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:12:58.142504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.154961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d448d7-7b80-4189-b780-43f8e2716abf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.160058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.160735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.161544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.161544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.162051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.163662 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.175142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1008/2026] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:58.178784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.191016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a57da-cf83-47f3-9fae-1a78d63e3654 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.195850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.196759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.197078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.197358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] PATH_INFO: `/v3/projects/772fb3c9034e4a45af580f7a2bb92a82/users/029d56d77bf744e8b718ce816f4fd4a1/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.205148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.206780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.214452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=772fb3c9034e4a45af580f7a2bb92a82, user_id=029d56d77bf744e8b718ce816f4fd4a1, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.217227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.217533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1019/2027] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:58.238049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1009/2028] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:58 2022] PUT /identity/v3/projects/772fb3c9034e4a45af580f7a2bb92a82/users/029d56d77bf744e8b718ce816f4fd4a1/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:12:58.239100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.250452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49623b-8e41-459f-99ff-5067caeb2b35 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.314654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909349a-f515-478e-b09a-6447214ecbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.315337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909349a-f515-478e-b09a-6447214ecbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.315616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909349a-f515-478e-b09a-6447214ecbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.315889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909349a-f515-478e-b09a-6447214ecbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.316615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909349a-f515-478e-b09a-6447214ecbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.318369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909349a-f515-478e-b09a-6447214ecbb7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.328007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1020/2029] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:12:58.332638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.342855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d58a8-6b1b-40ad-9a1e-f9ab8fc0a0fd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.347700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.348595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.348880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.349189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] PATH_INFO: `/v3/projects/772fb3c9034e4a45af580f7a2bb92a82/users/029d56d77bf744e8b718ce816f4fd4a1/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.351165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772fb3c9034e4a45af580f7a2bb92a82, user_id=029d56d77bf744e8b718ce816f4fd4a1, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.353822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.364579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1010/2030] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:12:58 2022] PUT /identity/v3/projects/772fb3c9034e4a45af580f7a2bb92a82/users/029d56d77bf744e8b718ce816f4fd4a1/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:12:58.374965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.375262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.375543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.405752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] MFA Rules not processed for user `029d56d77bf744e8b718ce816f4fd4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:12:58.407168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:58.437857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:58.479347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1021/2031] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:12:58.499232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.501642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:12:58.561753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeebe98-6b3f-4a11-85c9-23d20d21a4d0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.565579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.566253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.566539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.566820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.581702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.583353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.589528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:58.595119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1011/2032] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:12:58.635540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:12:58.645340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63283e7-c840-41d5-930a-6cc6330c077e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:12:58.649056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:12:58.649702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:12:58.649978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:12:58.650277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:12:58.714071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:12:58.715643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:12:58.725472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1022/2033] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:02.914141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:02.923176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc029a-9218-4316-ad15-3dc3bf12593f service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:02.927467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:02.928237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:02.928516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:02.928790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:02.993035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:02.994532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:03.004810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1012/2034] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:03.645367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:03.654717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383dc8-7992-49f8-90fc-1c36a5ec4871 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:03.658894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6eda22-a1c2-40cb-aa77-404a3e28f29e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:03.659553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6eda22-a1c2-40cb-aa77-404a3e28f29e service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:03.659839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6eda22-a1c2-40cb-aa77-404a3e28f29e service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:03.660118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6eda22-a1c2-40cb-aa77-404a3e28f29e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:03.731644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6eda22-a1c2-40cb-aa77-404a3e28f29e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:03.733185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6eda22-a1c2-40cb-aa77-404a3e28f29e service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:03.749613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1023/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:04.899483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:04.975759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92c5c0-8d73-41e7-b7f6-625a036cb7df service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:04.981272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:04.982576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:04.983007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:04.983424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] PATH_INFO: `/v3/users/d81adde90f184c2fb391b263cda98441` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:04.984796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81adde90f184c2fb391b263cda98441)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:04.987291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:05.049429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81adde90f184c2fb391b263cda98441'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.050304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81adde90f184c2fb391b263cda98441'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.051105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81adde90f184c2fb391b263cda98441'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.074833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81adde90f184c2fb391b263cda98441'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.101773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81adde90f184c2fb391b263cda98441'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.123539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1013/2036] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:04 2022] DELETE /identity/v3/users/d81adde90f184c2fb391b263cda98441 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:05.126953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:05.127442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:05.127658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:05.150761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:05.152587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:05.259331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:05.274470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1024/2037] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:05.282492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:05.284364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:05.323000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:05.391721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f398a-0458-47ab-95d9-b6ea7bfc129e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:05.396770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:05.397791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:05.398335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:05.398474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:05.410117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:05.411663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:05.426053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1014/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:05.798832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:05.800416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:05.813170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec03f7-c40d-4afb-a060-6673240b63b1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:05.819047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:05.820060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:05.820262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:05.820537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] PATH_INFO: `/v3/projects/069150fbdbe044ceaab22b9252a676c7` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:05.821951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] RBAC: Authorizing `identity:delete_project(project_id=069150fbdbe044ceaab22b9252a676c7)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:05.824062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:05.878153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069150fbdbe044ceaab22b9252a676c7', 'request_id': 'req-235fe5ed-d214-498d-b46c-ee8c49d9904f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.887041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069150fbdbe044ceaab22b9252a676c7', 'request_id': 'req-235fe5ed-d214-498d-b46c-ee8c49d9904f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.892890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069150fbdbe044ceaab22b9252a676c7', 'request_id': 'req-235fe5ed-d214-498d-b46c-ee8c49d9904f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.905214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] The token cache is being invalidate because project 069150fbdbe044ceaab22b9252a676c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:05.905409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.906049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:05.908020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1025/2039] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:05 2022] DELETE /identity/v3/projects/069150fbdbe044ceaab22b9252a676c7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:05.912026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:05.922803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e191b-8bbe-48ae-95ab-94f4a3989c7b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:05.987904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:05.988821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:05.989148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:05.989401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] PATH_INFO: `/v3/users/9466d9c1972c45559139df97807b6ccb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:05.990668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9466d9c1972c45559139df97807b6ccb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:05.992626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:06.057445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9466d9c1972c45559139df97807b6ccb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.058235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9466d9c1972c45559139df97807b6ccb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.058918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9466d9c1972c45559139df97807b6ccb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.067450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9466d9c1972c45559139df97807b6ccb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.084837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9466d9c1972c45559139df97807b6ccb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.102725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1015/2040] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:05 2022] DELETE /identity/v3/users/9466d9c1972c45559139df97807b6ccb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:06.649680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:06.651723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:06.689462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe5ed-d214-498d-b46c-ee8c49d9904f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:06.799147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:06.800117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:06.800405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:06.800679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] PATH_INFO: `/v3/projects/8d7584e940e2405691d07383649b80af` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:06.802088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7584e940e2405691d07383649b80af)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:06.804096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:06.883482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7584e940e2405691d07383649b80af', 'request_id': 'req-3a552d77-ddec-4b2f-aa0b-690160d195e6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.905320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7584e940e2405691d07383649b80af', 'request_id': 'req-3a552d77-ddec-4b2f-aa0b-690160d195e6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.917079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7584e940e2405691d07383649b80af', 'request_id': 'req-3a552d77-ddec-4b2f-aa0b-690160d195e6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.942706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] The token cache is being invalidate because project 8d7584e940e2405691d07383649b80af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:06.943014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.947056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:06.953541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1026/2041] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:06 2022] DELETE /identity/v3/projects/8d7584e940e2405691d07383649b80af => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:06.958163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:06.960668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:06.992886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448bdf6-53f4-4754-b004-e1e843f5d879 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:07.044332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:07.050939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:07.075390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:07.082858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:07.120842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:07.122172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.122610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.123032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] PATH_INFO: `/v3/users/029d56d77bf744e8b718ce816f4fd4a1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:07.124448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029d56d77bf744e8b718ce816f4fd4a1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:07.127834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:07.170927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552d77-ddec-4b2f-aa0b-690160d195e6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:07.176103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:07.177045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.177352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.177628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] PATH_INFO: `/v3/users/0da39d941803485b99e214d12444b98b` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:07.178838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da39d941803485b99e214d12444b98b)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:07.180768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:07.200366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029d56d77bf744e8b718ce816f4fd4a1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.201548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029d56d77bf744e8b718ce816f4fd4a1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.204080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029d56d77bf744e8b718ce816f4fd4a1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.216315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029d56d77bf744e8b718ce816f4fd4a1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.236273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4cdcab72-9150-44cd-b032-7dc634017901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029d56d77bf744e8b718ce816f4fd4a1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.254993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da39d941803485b99e214d12444b98b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.258401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1016/2042] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:06 2022] DELETE /identity/v3/users/029d56d77bf744e8b718ce816f4fd4a1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:07.266173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da39d941803485b99e214d12444b98b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.275447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da39d941803485b99e214d12444b98b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.297977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da39d941803485b99e214d12444b98b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.315306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da39d941803485b99e214d12444b98b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.330390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1027/2043] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:07 2022] DELETE /identity/v3/users/0da39d941803485b99e214d12444b98b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:07.336409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.336802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.337254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:07.361815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:07.363124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:07.442302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1017/2044] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:07.452007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:07.453483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:07.525828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23b2c1-365a-4846-ac83-cc815d03b90d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:07.530517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f0e3-8ee1-4ff5-aeb2-bd4c440d8a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:07.531106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f0e3-8ee1-4ff5-aeb2-bd4c440d8a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.531514 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f0e3-8ee1-4ff5-aeb2-bd4c440d8a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.531882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f0e3-8ee1-4ff5-aeb2-bd4c440d8a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:07.542572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0f0e3-8ee1-4ff5-aeb2-bd4c440d8a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:07.544117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0f0e3-8ee1-4ff5-aeb2-bd4c440d8a01 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:07.558811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1028/2045] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:07.648500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:07.650045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:07.662763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06d097-89d1-4f8a-a76d-0d66fb4d5832 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:07.670045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:07.671085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.671435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.671717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] PATH_INFO: `/v3/projects/772fb3c9034e4a45af580f7a2bb92a82` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:07.673567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772fb3c9034e4a45af580f7a2bb92a82)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:07.675482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:07.736179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772fb3c9034e4a45af580f7a2bb92a82', 'request_id': 'req-36289582-531d-4645-96f1-06a2f70b0f27'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.741465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:07.747540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772fb3c9034e4a45af580f7a2bb92a82', 'request_id': 'req-36289582-531d-4645-96f1-06a2f70b0f27'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.761718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772fb3c9034e4a45af580f7a2bb92a82', 'request_id': 'req-36289582-531d-4645-96f1-06a2f70b0f27'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.792546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] The token cache is being invalidate because project 772fb3c9034e4a45af580f7a2bb92a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:07.793073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.794071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-36289582-531d-4645-96f1-06a2f70b0f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:07.796498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1018/2046] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:07 2022] DELETE /identity/v3/projects/772fb3c9034e4a45af580f7a2bb92a82 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:07.802980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.803534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.803534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:07.843910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:07.853072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:07.923686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:07.977720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1029/2047] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:07.979769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:07.980768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:07.981295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.008068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:08.009591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.021005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1019/2048] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:08.025474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.035726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d7d5-37e6-4f89-81f8-e360cdcaebd1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.040591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.041284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.041568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.041992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.042724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:08.043014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.044998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.057271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1030/2049] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:13:08.061701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.071271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af7085-f99b-4775-bf79-3cc91fd5f5aa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.077286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.078031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.078231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.078505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.079219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.081209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.116671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1020/2050] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:08.119244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.131470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c38d-cc69-4246-b221-9b66109f01c5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.158418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.161794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.213672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.214576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.214859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.215135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.215882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.217828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.239492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9112-7f92-4f91-b947-5a844097d7e6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.239673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1031/2051] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:08.243562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.244225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.245140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.245424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.245700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] PATH_INFO: `/v3/projects/e8783f8ed20141d09ba50585f0a3ce76` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.246883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8783f8ed20141d09ba50585f0a3ce76)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.248786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.254208 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60897a-69d0-4dc9-bee5-0cef9e55b455 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.259623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.260282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.260559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.260834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.261598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.263184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.276601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1032/2052] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:08.277766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.287592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0c8c-953e-4863-8db5-9739193f31c0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.298748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8783f8ed20141d09ba50585f0a3ce76', 'request_id': 'req-77d5b923-32c6-499c-a8f4-74802d04742f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.311098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8783f8ed20141d09ba50585f0a3ce76', 'request_id': 'req-77d5b923-32c6-499c-a8f4-74802d04742f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.317391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8783f8ed20141d09ba50585f0a3ce76', 'request_id': 'req-77d5b923-32c6-499c-a8f4-74802d04742f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.332195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] The token cache is being invalidate because project e8783f8ed20141d09ba50585f0a3ce76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:08.332704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.333393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77d5b923-32c6-499c-a8f4-74802d04742f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.334983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1021/2053] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:08 2022] DELETE /identity/v3/projects/e8783f8ed20141d09ba50585f0a3ce76 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:08.339636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.339926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.340212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.357007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.357799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.358087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.358361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.359100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.359611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:08.360780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.360885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.374799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1033/2054] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:08.374799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.375052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1022/2055] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:08.375142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.376585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.378127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.387983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476461-6418-4246-ad5c-1b379455fec0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.389883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24931de-ccb1-4f91-9e2f-1d761c876da4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.392600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.393531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.393819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.394093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] PATH_INFO: `/v3/users/508896029b5041f0801eec048821c491` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.395194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e5996-5f68-49ad-a735-bab4849caf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.395338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] RBAC: Authorizing `identity:delete_user(user_id=508896029b5041f0801eec048821c491)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.396217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5996-5f68-49ad-a735-bab4849caf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.396579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5996-5f68-49ad-a735-bab4849caf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.396906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5996-5f68-49ad-a735-bab4849caf5c admin admin] PATH_INFO: `/v3/projects/75c85f25e2fd428c90930216166e09ae/users/cd12bebfbe0f49ba8d84cbf8692c110f/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.397229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.412348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e5996-5f68-49ad-a735-bab4849caf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c85f25e2fd428c90930216166e09ae, user_id=cd12bebfbe0f49ba8d84cbf8692c110f, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.415806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e5996-5f68-49ad-a735-bab4849caf5c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.431577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1023/2056] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:08 2022] PUT /identity/v3/projects/75c85f25e2fd428c90930216166e09ae/users/cd12bebfbe0f49ba8d84cbf8692c110f/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:08.433137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246225f-ad01-42e0-83e8-7d323b0c4a1e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.433416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246225f-ad01-42e0-83e8-7d323b0c4a1e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.433703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246225f-ad01-42e0-83e8-7d323b0c4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.443198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:08.452147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f246225f-ad01-42e0-83e8-7d323b0c4a1e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:08.453421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f246225f-ad01-42e0-83e8-7d323b0c4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.458581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508896029b5041f0801eec048821c491'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.459323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508896029b5041f0801eec048821c491'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.459975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508896029b5041f0801eec048821c491'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.466038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:08.468390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508896029b5041f0801eec048821c491'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.482270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8283d715-0664-42c2-a8d4-4b6e5965549a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508896029b5041f0801eec048821c491'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:08.498448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1034/2057] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:08 2022] DELETE /identity/v3/users/508896029b5041f0801eec048821c491 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:08.499747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.500150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.500435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.522980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1024/2058] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:08.526788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.527075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.527348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.528272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] MFA Rules not processed for user `cd12bebfbe0f49ba8d84cbf8692c110f`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:08.529530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.546099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:08.546936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.604461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1035/2059] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:08.605395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.617741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1025/2060] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:08.618657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.619992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.630615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22e49-2e04-4ea4-91ff-7a74ffb39c69 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.632267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a457e-9e58-4447-b8b1-6cd2804ded2c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.635460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.636197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.636646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.636866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.636957 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.637633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.639804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:08.639937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.639937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.640094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.640165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.640246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.640741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.654404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1036/2061] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:13:08.655191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.656964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:08.673269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1026/2062] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:08.673675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.724522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389cc99-d951-4162-a912-a48b12a2a0d0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.742317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739b26-10a1-4504-8207-21f320f823d6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.747094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.747773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.748051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.748329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.749199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.751536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.771140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:08.782015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.783095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.783505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.784104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.789136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1027/2063] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:08.789136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.795358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.796956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.807409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1037/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:08.808182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.808297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:08.818206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1c48-d8df-435a-87d9-068b00fcf1c2 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.876934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bdd9-ae12-419b-9e75-bf5d88853647 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.880765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.882087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.882484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.882854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.883822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.885083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.885918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.886055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.886554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.886932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.888147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.890411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.917210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1038/2065] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:08.918444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.921635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1028/2066] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:08 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:08.925403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.930735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639636d-194c-468d-a566-89ef3aa6b5fc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.936614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.936943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ff6ac-cae9-4a51-9331-2ec446a1aeba admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.937460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.937748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.938034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.939221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.941504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.943544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.944300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.944902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.945328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.946095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.948437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.953480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1039/2067] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:08.957945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.962221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1029/2068] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:08.967232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:08.971568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb9f8-e85d-4179-b4df-014f93c5018c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.977263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f045b-ef94-4f8c-b319-201d50cee2c6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:08.977956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.978831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.979284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.979743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.980625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:08.982340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:08.982933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:08.983318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:08.983602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:08.983876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] PATH_INFO: `/v3/projects/c95507b58199482ca01d40f724e7ad2b/users/529a9185de4342c58f9b9b84f9f43d85/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:08.999642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1040/2069] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:09.002371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95507b58199482ca01d40f724e7ad2b, user_id=529a9185de4342c58f9b9b84f9f43d85, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.005146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.007890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.021553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3c88-8fe7-4135-b6a2-243e59da1adc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.027519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1030/2070] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:08 2022] PUT /identity/v3/projects/c95507b58199482ca01d40f724e7ad2b/users/529a9185de4342c58f9b9b84f9f43d85/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:09.034822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.112164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.113175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.113461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.113875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] PATH_INFO: `/v3/projects/bb792d3a93514815b2c1063fcf75b76d/users/46abdb11334a4385aa175135fff923fe/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.134755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb792d3a93514815b2c1063fcf75b76d, user_id=46abdb11334a4385aa175135fff923fe, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.137903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.139892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec861a9-0cb7-475e-aa57-1e94a757df65 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.146428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581c0f-931b-4a31-9b67-d4aba418ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.147326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c0f-931b-4a31-9b67-d4aba418ba79 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.147672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c0f-931b-4a31-9b67-d4aba418ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.148116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c0f-931b-4a31-9b67-d4aba418ba79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.148958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581c0f-931b-4a31-9b67-d4aba418ba79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.150709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581c0f-931b-4a31-9b67-d4aba418ba79 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.157331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1041/2071] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:09 2022] PUT /identity/v3/projects/bb792d3a93514815b2c1063fcf75b76d/users/46abdb11334a4385aa175135fff923fe/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:09.167013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1031/2072] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:09.168604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.179587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1d63-7700-4ce1-a0d8-e8e430585f14 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.180196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1d63-7700-4ce1-a0d8-e8e430585f14 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.180671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1d63-7700-4ce1-a0d8-e8e430585f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.244544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:09.247449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-91db1d63-7700-4ce1-a0d8-e8e430585f14 None None] MFA Rules not processed for user `46abdb11334a4385aa175135fff923fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:09.248736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-91db1d63-7700-4ce1-a0d8-e8e430585f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.288334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d694f-7da7-41b0-9ef6-e505a78d86c9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.315906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.319067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.319357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.319710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] PATH_INFO: `/v3/projects/c95507b58199482ca01d40f724e7ad2b/users/529a9185de4342c58f9b9b84f9f43d85/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.325975 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95507b58199482ca01d40f724e7ad2b, user_id=529a9185de4342c58f9b9b84f9f43d85, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.330490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.355332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1042/2073] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:09 2022] PUT /identity/v3/projects/c95507b58199482ca01d40f724e7ad2b/users/529a9185de4342c58f9b9b84f9f43d85/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:09.355332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.357860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.381264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:09.398907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1032/2074] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:09.400363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.400583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.402639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.439724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] MFA Rules not processed for user `529a9185de4342c58f9b9b84f9f43d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:09.441071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.484517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b0559-e6fb-4f66-a6a0-de99ece883dc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.490064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.491092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.491393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.491667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] PATH_INFO: `/v3/projects/0ab94ae3023741ad8f63b325dae9cf54` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.493399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab94ae3023741ad8f63b325dae9cf54)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.495326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.547492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1033/2075] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:09.547492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.547492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.553419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab94ae3023741ad8f63b325dae9cf54', 'request_id': 'req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.563216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab94ae3023741ad8f63b325dae9cf54', 'request_id': 'req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.570197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab94ae3023741ad8f63b325dae9cf54', 'request_id': 'req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.586931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] The token cache is being invalidate because project 0ab94ae3023741ad8f63b325dae9cf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:09.587233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.588612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.591034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1043/2076] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:09 2022] DELETE /identity/v3/projects/0ab94ae3023741ad8f63b325dae9cf54 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:09.591150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.594282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.620953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8fc9e-c6d3-4a7e-8444-8ca494b9a8cb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.677567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.678319 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.678666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.679005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.681159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.682082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc76fa-da89-4e7b-9eb1-edebb4405d9e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.685858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.686504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.686782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.687049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.688973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.701640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:09.739332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:09.744023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.745527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.753275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.754756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.755368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1034/2077] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:09.756198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:09.758658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:09.764965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1044/2078] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:09.843965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c8c7-9764-46c0-8a2e-0edec249f1a2 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:09.850408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:09.852088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:09.852378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:09.852812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] PATH_INFO: `/v3/users/4f854adfe64149f0a4661c5a8b1fb4a0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:09.854121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f854adfe64149f0a4661c5a8b1fb4a0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:09.856410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:09.946125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f854adfe64149f0a4661c5a8b1fb4a0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.946823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f854adfe64149f0a4661c5a8b1fb4a0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.948228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f854adfe64149f0a4661c5a8b1fb4a0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.963613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f854adfe64149f0a4661c5a8b1fb4a0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:09.988332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-17185b44-be9c-4d27-a013-b36a3c6d9e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f854adfe64149f0a4661c5a8b1fb4a0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.005553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1035/2079] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:09 2022] DELETE /identity/v3/users/4f854adfe64149f0a4661c5a8b1fb4a0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:10.247320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:10.249198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:10.263827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2022-a785-4e38-a735-b8921f10d856 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:10.349976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:10.350867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:10.351147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:10.351421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] PATH_INFO: `/v3/users/cd12bebfbe0f49ba8d84cbf8692c110f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:10.352612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd12bebfbe0f49ba8d84cbf8692c110f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:10.354584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:10.406539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd12bebfbe0f49ba8d84cbf8692c110f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.407957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd12bebfbe0f49ba8d84cbf8692c110f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.408435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd12bebfbe0f49ba8d84cbf8692c110f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.416426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd12bebfbe0f49ba8d84cbf8692c110f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.429469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd12bebfbe0f49ba8d84cbf8692c110f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.446421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1045/2080] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:10 2022] DELETE /identity/v3/users/cd12bebfbe0f49ba8d84cbf8692c110f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:10.452156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:10.452156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:10.452156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:10.471700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:10.473123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:10.475953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:10.477389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:10.522222 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:10.555487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1036/2081] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:10.561793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746d20-9f98-4465-b8ca-6ac06971853e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:10.565065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:10.566411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:10.566839 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:10.567745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:10.568076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:10.568572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] PATH_INFO: `/v3/projects/a8e9fce847f4474fbbc003d999083458` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:10.570151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e9fce847f4474fbbc003d999083458)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:10.572461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:10.586466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:10.631129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e9fce847f4474fbbc003d999083458', 'request_id': 'req-9d9c7045-ca98-4a5a-860a-165adda14eb3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.640853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab1242-3f7a-4cff-9740-57b6d858a338 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:10.641079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e9fce847f4474fbbc003d999083458', 'request_id': 'req-9d9c7045-ca98-4a5a-860a-165adda14eb3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.647697 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e9fce847f4474fbbc003d999083458', 'request_id': 'req-9d9c7045-ca98-4a5a-860a-165adda14eb3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.661243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] The token cache is being invalidate because project a8e9fce847f4474fbbc003d999083458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:10.661824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.662379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.664017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1046/2082] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:10 2022] DELETE /identity/v3/projects/a8e9fce847f4474fbbc003d999083458 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:10.667854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:10.669655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:10.705542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:10.706293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:10.706641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:10.708199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:10.709585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:10.746398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7045-ca98-4a5a-860a-165adda14eb3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:10.752156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:10.753195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:10.753475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:10.753756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] PATH_INFO: `/v3/users/879d5e358dd84aa5b06616f80ec108a1` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:10.754977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] RBAC: Authorizing `identity:delete_user(user_id=879d5e358dd84aa5b06616f80ec108a1)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:10.756917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:10.799005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:10.803575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:10.834167 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1037/2083] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:13:10.852297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879d5e358dd84aa5b06616f80ec108a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.853152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879d5e358dd84aa5b06616f80ec108a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.853827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879d5e358dd84aa5b06616f80ec108a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.864210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879d5e358dd84aa5b06616f80ec108a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.870165 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:10.881817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879d5e358dd84aa5b06616f80ec108a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:10.899902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1047/2084] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:10 2022] DELETE /identity/v3/users/879d5e358dd84aa5b06616f80ec108a1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:11.284210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:11.285929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:11.326225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6daa59-402e-4e48-8f41-336e2fa0d709 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:11.336438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:11.337990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:11.456054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:11.456963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.457300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.457562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] PATH_INFO: `/v3/projects/75c85f25e2fd428c90930216166e09ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.459557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c85f25e2fd428c90930216166e09ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:11.462797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:11.474506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a5d07-9cd0-4bec-8c70-65906069794f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:11.481263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:11.482357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.482750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.483091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] PATH_INFO: `/v3/projects/2a3d995ae11f4ed1b52b4f3eb9f9caa3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.484352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3d995ae11f4ed1b52b4f3eb9f9caa3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:11.486817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:11.496589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:11.533556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c85f25e2fd428c90930216166e09ae', 'request_id': 'req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.543645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c85f25e2fd428c90930216166e09ae', 'request_id': 'req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.553229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c85f25e2fd428c90930216166e09ae', 'request_id': 'req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.554081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3d995ae11f4ed1b52b4f3eb9f9caa3', 'request_id': 'req-a413ac01-69e0-49ff-be77-7a4c6efce227'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.567551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3d995ae11f4ed1b52b4f3eb9f9caa3', 'request_id': 'req-a413ac01-69e0-49ff-be77-7a4c6efce227'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.570888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] The token cache is being invalidate because project 75c85f25e2fd428c90930216166e09ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:11.571555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.579646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.586004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3d995ae11f4ed1b52b4f3eb9f9caa3', 'request_id': 'req-a413ac01-69e0-49ff-be77-7a4c6efce227'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.587451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1038/2085] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:11 2022] DELETE /identity/v3/projects/75c85f25e2fd428c90930216166e09ae => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:11.588916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:11.590032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:11.613192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] The token cache is being invalidate because project 2a3d995ae11f4ed1b52b4f3eb9f9caa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:11.613192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.613822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a413ac01-69e0-49ff-be77-7a4c6efce227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.622844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1048/2086] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:11 2022] DELETE /identity/v3/projects/2a3d995ae11f4ed1b52b4f3eb9f9caa3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:11.627896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf786cd-e7e6-4be5-9f9c-3aa360e9f6d1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.629055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf786cd-e7e6-4be5-9f9c-3aa360e9f6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.632662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf786cd-e7e6-4be5-9f9c-3aa360e9f6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.678497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-caf786cd-e7e6-4be5-9f9c-3aa360e9f6d1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:11.680529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-caf786cd-e7e6-4be5-9f9c-3aa360e9f6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:11.722348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d7068-3d92-4983-8bd9-ea4eca8c1252 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:11.766341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1049/2087] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:11.780777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.781100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.781385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.812339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:11.816364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:11.817419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.817777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.818212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] PATH_INFO: `/v3/users/529a9185de4342c58f9b9b84f9f43d85` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.819201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:11.819901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529a9185de4342c58f9b9b84f9f43d85)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:11.822349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:11.839284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1050/2088] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:11.844098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:11.850329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:11.856479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1af7f-a7c4-4a4f-80f6-35baa1a23b7c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:11.863774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:11.865104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.865933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.866769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.867726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:11.868428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:11.871184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:11.899213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1051/2089] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:13:11.900307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:11.901845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529a9185de4342c58f9b9b84f9f43d85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.902777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529a9185de4342c58f9b9b84f9f43d85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.904561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:11.906206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529a9185de4342c58f9b9b84f9f43d85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.922789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529a9185de4342c58f9b9b84f9f43d85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.925036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7353f0-d75b-49cf-823b-3591795beb9a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:11.926547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:11.930604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:11.931466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:11.931803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:11.932023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:11.932743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:11.934743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:11.947813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529a9185de4342c58f9b9b84f9f43d85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:11.977343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1039/2090] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:11 2022] DELETE /identity/v3/users/529a9185de4342c58f9b9b84f9f43d85 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:11.981217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1052/2091] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:11 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:11.992271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.072674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf107c-63b2-4df0-bb07-88f4d8ed0bd8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.132777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.133506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.133792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.134066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.134803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.136748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.157860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1040/2092] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:11 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:12.162104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.173276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7e6fd-c281-46c6-9c1d-dc2d512f345e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.178983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.179663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.179943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.180229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.180952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.182599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.193707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1053/2093] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:12.197647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.208985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f793645-f436-40a8-9d41-0e57410bf8cf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.214752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f34a2-1f15-4b6d-abc2-e7c2bb8658fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.215443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f34a2-1f15-4b6d-abc2-e7c2bb8658fe admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.215723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f34a2-1f15-4b6d-abc2-e7c2bb8658fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.215996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f34a2-1f15-4b6d-abc2-e7c2bb8658fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.216742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f34a2-1f15-4b6d-abc2-e7c2bb8658fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.219023 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f34a2-1f15-4b6d-abc2-e7c2bb8658fe admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.236971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1041/2094] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:12.244024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.268036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d06a-b63a-4697-b37a-2227a6576e93 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.273583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.274750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.275095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.275433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] PATH_INFO: `/v3/projects/fd3b1d809bab4a86ba53fa492ffa827d/users/1935cd7481134d1087a2dac4cdeb9ced/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.294378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3b1d809bab4a86ba53fa492ffa827d, user_id=1935cd7481134d1087a2dac4cdeb9ced, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.297168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.313735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1054/2095] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:12 2022] PUT /identity/v3/projects/fd3b1d809bab4a86ba53fa492ffa827d/users/1935cd7481134d1087a2dac4cdeb9ced/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:12.386661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.387201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.387865 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.415609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] MFA Rules not processed for user `1935cd7481134d1087a2dac4cdeb9ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:12.416890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:12.480673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.480673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:12.482433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:12.510516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1042/2096] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:12.522407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.524868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:12.560800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d4df-5773-4edc-8df1-75d2bf69b036 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.566013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.567052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.567402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.567740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] PATH_INFO: `/v3/projects/c95507b58199482ca01d40f724e7ad2b` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.569002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95507b58199482ca01d40f724e7ad2b)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.570990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.587369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fa0c7-8e62-438d-84f0-b87cea4ff25e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.591478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b6072-160f-4bbc-b021-1d0a1121ace6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.592136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b6072-160f-4bbc-b021-1d0a1121ace6 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.592415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b6072-160f-4bbc-b021-1d0a1121ace6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.592688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b6072-160f-4bbc-b021-1d0a1121ace6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.607574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b6072-160f-4bbc-b021-1d0a1121ace6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.609359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b6072-160f-4bbc-b021-1d0a1121ace6 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.619634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1043/2097] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:13:12.620340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95507b58199482ca01d40f724e7ad2b', 'request_id': 'req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.628688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95507b58199482ca01d40f724e7ad2b', 'request_id': 'req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.635992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95507b58199482ca01d40f724e7ad2b', 'request_id': 'req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.648439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] The token cache is being invalidate because project c95507b58199482ca01d40f724e7ad2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:12.648781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.649716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.651705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1055/2098] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:12 2022] DELETE /identity/v3/projects/c95507b58199482ca01d40f724e7ad2b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:12.656781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d156-c763-4a21-b821-7cf2b3663255 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.657092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d156-c763-4a21-b821-7cf2b3663255 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.657464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d156-c763-4a21-b821-7cf2b3663255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.676720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0ba9d156-c763-4a21-b821-7cf2b3663255 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:12.678404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0ba9d156-c763-4a21-b821-7cf2b3663255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:12.709192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.710597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:12.756753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:12.771477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1044/2099] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:12.800769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.801263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.801614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.810102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3e8d9-4318-48eb-8ac4-f31678b7363c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.822145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.824855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.825338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.825621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] PATH_INFO: `/v3/users/46abdb11334a4385aa175135fff923fe` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.829066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46abdb11334a4385aa175135fff923fe)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.831431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.836961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:12.842098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:12.861731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1045/2100] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:12.866522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.882155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21780d-b1ae-418f-ab2e-1903e26626d1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.887880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.888928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.889594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.890010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.892703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:12.893220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.895475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.922510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1046/2101] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:13:12.927620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:12.939514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75fa3-38be-4d75-8bca-9c1560d8e7a4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:12.944738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:12.945516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:12.946007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:12.956532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:12.956532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:12.956532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:12.959728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46abdb11334a4385aa175135fff923fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.960613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46abdb11334a4385aa175135fff923fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.961414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46abdb11334a4385aa175135fff923fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.973403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46abdb11334a4385aa175135fff923fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.992584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b153a65e-25eb-48a3-81c6-4ce542b30bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46abdb11334a4385aa175135fff923fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:12.998963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1047/2102] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:12 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:13.004008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.007943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.018007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1056/2103] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:12 2022] DELETE /identity/v3/users/46abdb11334a4385aa175135fff923fe => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:13.023558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.035249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.035750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.074913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:13.083862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.103269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:13.142363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585728a-29fc-4d6b-aafd-89ebee273909 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.213052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1057/2104] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:13.220310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.221937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.272653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.280102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.280102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.293900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.294683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.297743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.305729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:13.321429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f9f6-478f-4821-b736-82e92ccc2707 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.326383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.327363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.327518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1048/2105] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/users => generated 288 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:13:13.327652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.327914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.331681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.342114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c8291-6104-4abe-b613-5fa8daa1dff4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.347081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.348031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.348750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.349066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.349329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.349701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.350222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.351841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.364006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1049/2106] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:13.368100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.369184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1058/2107] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:13.380519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a097cc-3678-408f-9dad-80ec04c7682a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.385297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7748-aafd-46f9-b408-aaf166d9ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.385971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7748-aafd-46f9-b408-aaf166d9ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.386253 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7748-aafd-46f9-b408-aaf166d9ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.386529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7748-aafd-46f9-b408-aaf166d9ef44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.387267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb7748-aafd-46f9-b408-aaf166d9ef44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.388861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb7748-aafd-46f9-b408-aaf166d9ef44 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.401908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1050/2108] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:13.406121 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.417510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e50c9-4c91-428e-b802-7e4b65a70827 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.424875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.425812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.426100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.426394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] PATH_INFO: `/v3/projects/7c1d90968adf49b4b413b545eb2cdf8b/users/aae3004eb39840639465077abd992a2d/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.458412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1d90968adf49b4b413b545eb2cdf8b, user_id=aae3004eb39840639465077abd992a2d, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.462005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.482465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1059/2109] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:13 2022] PUT /identity/v3/projects/7c1d90968adf49b4b413b545eb2cdf8b/users/aae3004eb39840639465077abd992a2d/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:13.491010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.491328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.491608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.525775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] MFA Rules not processed for user `aae3004eb39840639465077abd992a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:13.527322 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.609387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1051/2110] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:13.615228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.692863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8f3bb-a031-4278-8e8d-6709137bdabd admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.698946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.699954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.700477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.700802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.701608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.703793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.716040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.718021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.737711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47c4b3-331e-4f0e-9c2b-e64fb9a80bfe None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.740856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1060/2111] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:13.742160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.808689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:13.813525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.814906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.815568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.816393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] PATH_INFO: `/v3/projects/bb792d3a93514815b2c1063fcf75b76d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.816827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42280222-ed6e-4ca9-8760-8f8de6362e72 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.818193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb792d3a93514815b2c1063fcf75b76d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.820720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.822153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.822924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.823098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.823540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.824269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.826210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.849107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1061/2112] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:13.853640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.866111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224ef1-c82e-416d-8de4-fa664a6ee11e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.880339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb792d3a93514815b2c1063fcf75b76d', 'request_id': 'req-247af52f-5842-4c30-8cf7-78235b704b5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:13.891698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb792d3a93514815b2c1063fcf75b76d', 'request_id': 'req-247af52f-5842-4c30-8cf7-78235b704b5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:13.901902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb792d3a93514815b2c1063fcf75b76d', 'request_id': 'req-247af52f-5842-4c30-8cf7-78235b704b5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:13.908970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:13.914810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] The token cache is being invalidate because project bb792d3a93514815b2c1063fcf75b76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:13.915121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:13.915823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-247af52f-5842-4c30-8cf7-78235b704b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:13.917922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1052/2113] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:13 2022] DELETE /identity/v3/projects/bb792d3a93514815b2c1063fcf75b76d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:13.922721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355652-0ae7-4951-9558-a4705cfa538a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.923738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355652-0ae7-4951-9558-a4705cfa538a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.924159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355652-0ae7-4951-9558-a4705cfa538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.945345 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.946060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.946342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.946614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.947375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.948993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:13.952080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-72355652-0ae7-4951-9558-a4705cfa538a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:13.953436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-72355652-0ae7-4951-9558-a4705cfa538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.962441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1053/2114] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:13.965187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1062/2115] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:13.970105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:13.970763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.971176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.971461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.972878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.989174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c1ab3-2322-4acc-940c-05314969fc86 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:13.992339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:13.993879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:13.994147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:13.994898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:13.995249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:13.995590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:13.996424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:13.998130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.004273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1054/2116] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:14.008224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.014971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1063/2117] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:14.017779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02240c14-9841-40e2-a1a0-ddc363c9b16f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.019152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.025137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.026125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.026817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.026817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.027573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:14.027985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.029908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.030044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc48b5-bcd3-41cb-ba31-f63c50eb0b88 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.037591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33bafe-328c-4074-93fb-f6db8b57f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.038506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33bafe-328c-4074-93fb-f6db8b57f1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.038787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33bafe-328c-4074-93fb-f6db8b57f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.039060 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33bafe-328c-4074-93fb-f6db8b57f1f7 admin admin] PATH_INFO: `/v3/projects/b3a5f989ae9d4a3fb26b54e0653aa42f/users/0f65a4a1e3904f2ab44c292604d0e49e/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.053718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1055/2118] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:13:14.054830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.055022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33bafe-328c-4074-93fb-f6db8b57f1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a5f989ae9d4a3fb26b54e0653aa42f, user_id=0f65a4a1e3904f2ab44c292604d0e49e, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.057756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33bafe-328c-4074-93fb-f6db8b57f1f7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.066502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25e9e-6d66-4b5a-8116-bce03207e1d6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.074285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1064/2119] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:14 2022] PUT /identity/v3/projects/b3a5f989ae9d4a3fb26b54e0653aa42f/users/0f65a4a1e3904f2ab44c292604d0e49e/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:14.085385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.085753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.086099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.113732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] MFA Rules not processed for user `0f65a4a1e3904f2ab44c292604d0e49e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:14.115241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.147565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.148257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.148600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.149712 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.150495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.153113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.198052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1056/2120] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:14.202089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.204453 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1065/2121] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:14.208695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.222140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d71e51-1369-49bd-a330-cf7c3323d38c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.262217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:14.280514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e400-4993-40a6-ae9d-5cea66f39ed4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.288193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.288871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.289088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6b66f-fa2e-4ad4-8cc8-664120c3ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.289230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.289439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.289820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b66f-fa2e-4ad4-8cc8-664120c3ead1 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.290103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b66f-fa2e-4ad4-8cc8-664120c3ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.290195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.290375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b66f-fa2e-4ad4-8cc8-664120c3ead1 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.291218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b66f-fa2e-4ad4-8cc8-664120c3ead1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.292053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.293336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b66f-fa2e-4ad4-8cc8-664120c3ead1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.324025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1057/2122] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/users => generated 282 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:13:14.325547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.325836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.326116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.340120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1066/2123] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:14.340120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.346810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] MFA Rules not processed for user `1935cd7481134d1087a2dac4cdeb9ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:14.348032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.351709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:14.405171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78322-6bcf-4be9-9528-f996d493bdee admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.410173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.410846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.411124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.411395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.412203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.413869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.415584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1058/2124] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:14.416628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.432368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1067/2125] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:14.432538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9493ae-99ba-4a09-95b8-89e6e644933d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.434606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.437250 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.437973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.438391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.438990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.440142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.442973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.446731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1890a4-8b0e-4e94-976a-6b6186f75bbf admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.456148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.457205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.457685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.458046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.459494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.461467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.474430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1059/2126] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/users => generated 294 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:14.478827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.489989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1068/2127] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:14.491894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.503127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478c0b-2ef4-444c-8fad-a30c7c59eddd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.504282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0dc23-26f4-493a-bf83-6c8bf64bdc65 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.508858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.509245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930d61-fe68-48a6-abaa-a97cd0473d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.509580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.509863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.510138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.510630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930d61-fe68-48a6-abaa-a97cd0473d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.510886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.511110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930d61-fe68-48a6-abaa-a97cd0473d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.511480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930d61-fe68-48a6-abaa-a97cd0473d36 admin admin] PATH_INFO: `/v3/projects/1fe2d430c9d94824b3dd5162bce18517/users/12c1c0a85b834811b8124b095aa00399/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.512498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.524860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1060/2128] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:14.529035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.531986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930d61-fe68-48a6-abaa-a97cd0473d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe2d430c9d94824b3dd5162bce18517, user_id=12c1c0a85b834811b8124b095aa00399, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.536335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930d61-fe68-48a6-abaa-a97cd0473d36 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.542446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b44f0-903f-4e02-a14d-6cc0dec525a4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.549564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.550869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.551369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.551824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] PATH_INFO: `/v3/projects/245e21070dea402cbcf771612ac167e8/users/ba370c4d68d84532bfb462b436fed02c/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.568390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1069/2129] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:14 2022] PUT /identity/v3/projects/1fe2d430c9d94824b3dd5162bce18517/users/12c1c0a85b834811b8124b095aa00399/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:14.570209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.570503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.570782 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.583211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245e21070dea402cbcf771612ac167e8, user_id=ba370c4d68d84532bfb462b436fed02c, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.586265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.603472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1061/2130] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:14 2022] PUT /identity/v3/projects/245e21070dea402cbcf771612ac167e8/users/ba370c4d68d84532bfb462b436fed02c/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:14.611643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.616196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] MFA Rules not processed for user `12c1c0a85b834811b8124b095aa00399`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:14.617573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.686022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4549f-b7cd-4fa8-918a-2d9bc0b97c89 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.691702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.692511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.692794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.693481 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.694360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.696131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.698260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1070/2131] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:14.710836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.712260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.715297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1062/2132] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:14.718269 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.729406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3de15-7fcb-42e5-8ede-5489045f7bef admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.734509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5f394-e823-4d72-b04a-fd93fda4af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.736157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f394-e823-4d72-b04a-fd93fda4af8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.736157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f394-e823-4d72-b04a-fd93fda4af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.736561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f394-e823-4d72-b04a-fd93fda4af8f admin admin] PATH_INFO: `/v3/projects/245e21070dea402cbcf771612ac167e8/users/ba370c4d68d84532bfb462b436fed02c/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.738883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5f394-e823-4d72-b04a-fd93fda4af8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=245e21070dea402cbcf771612ac167e8, user_id=ba370c4d68d84532bfb462b436fed02c, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.741744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5f394-e823-4d72-b04a-fd93fda4af8f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.754867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1063/2133] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:14 2022] PUT /identity/v3/projects/245e21070dea402cbcf771612ac167e8/users/ba370c4d68d84532bfb462b436fed02c/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:14.765161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.765451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.765730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.782932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a1a28-bcf2-40e1-848e-8b0ff8aa8796 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.785765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:14.794895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] MFA Rules not processed for user `ba370c4d68d84532bfb462b436fed02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:14.796365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.797452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:14.845478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.846297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.846765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.846854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.876414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1064/2134] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:14.889094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:14.890743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.904025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd083-4adf-4b71-b598-f746facb43fd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:14.908163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:14.908752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:14.909087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:14.909342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:14.912064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:14.915564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:14.917029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:14.927910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1071/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:13:15.010804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:15.012352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:15.039530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1065/2136] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:13:17.730836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:17.740497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38ab2-0acb-47e1-8a03-3ef30d39d38d service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:17.744766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe36225-985e-4509-bfae-ee283ad843a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:17.746234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe36225-985e-4509-bfae-ee283ad843a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:17.746534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe36225-985e-4509-bfae-ee283ad843a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:17.746806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe36225-985e-4509-bfae-ee283ad843a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:17.814787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe36225-985e-4509-bfae-ee283ad843a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:17.817762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe36225-985e-4509-bfae-ee283ad843a1 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:17.828551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1072/2137] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:18.703053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:18.712638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad436e6b-360d-4f92-ad5c-b74c7914fc08 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:18.717083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:18.717752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:18.718038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:18.718375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:18.728988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:18.730632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:18.746148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1066/2138] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:20.515605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c951f5b-f3b3-4900-a389-b4488600b705 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:20.516137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c951f5b-f3b3-4900-a389-b4488600b705 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:20.516137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c951f5b-f3b3-4900-a389-b4488600b705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:20.573960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2c951f5b-f3b3-4900-a389-b4488600b705 None None] MFA Rules not processed for user `aaefc46a7e6d431c9eebc5233389c61e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:20.575210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2c951f5b-f3b3-4900-a389-b4488600b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:20.665801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1073/2139] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:22.921523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:22.991137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481f46-9cb1-42a8-9739-da6f002dfe3b service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:22.995597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:22.996670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:22.996972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:22.997299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] PATH_INFO: `/v3/users/aae3004eb39840639465077abd992a2d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:22.998480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae3004eb39840639465077abd992a2d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:23.000755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:23.026159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:23.066433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae3004eb39840639465077abd992a2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.067116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae3004eb39840639465077abd992a2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.067742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae3004eb39840639465077abd992a2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.075944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae3004eb39840639465077abd992a2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.091473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae3004eb39840639465077abd992a2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.111323 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1067/2140] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:22 2022] DELETE /identity/v3/users/aae3004eb39840639465077abd992a2d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:23.119369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:23.119902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:23.119998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:23.146650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:23.148020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:23.158994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:23.213579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1074/2141] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:23.225649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:23.227521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:23.302700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71fd1-2214-4249-b8eb-54014810c435 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:23.312795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:23.313942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:23.314245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:23.314502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:23.324873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:23.326464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:23.337288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1068/2142] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:23.619342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:23.621068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:23.634669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adc38-5fbd-43c6-ad96-59c07119a3d7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:23.640385 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:23.641361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:23.641699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:23.641978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] PATH_INFO: `/v3/projects/7c1d90968adf49b4b413b545eb2cdf8b` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:23.645171 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1d90968adf49b4b413b545eb2cdf8b)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:23.647276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:23.700130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1d90968adf49b4b413b545eb2cdf8b', 'request_id': 'req-1b1df467-eb16-4bde-96bf-d388d58660e1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.708114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1d90968adf49b4b413b545eb2cdf8b', 'request_id': 'req-1b1df467-eb16-4bde-96bf-d388d58660e1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.716582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1d90968adf49b4b413b545eb2cdf8b', 'request_id': 'req-1b1df467-eb16-4bde-96bf-d388d58660e1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.729080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] The token cache is being invalidate because project 7c1d90968adf49b4b413b545eb2cdf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:23.729372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.730030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.731845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1075/2143] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:23 2022] DELETE /identity/v3/projects/7c1d90968adf49b4b413b545eb2cdf8b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:23.736114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:23.745843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323fc5d-2719-4ad3-a809-e7d464d04cdb service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:23.811620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:23.812514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:23.812800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:23.813101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] PATH_INFO: `/v3/users/0f65a4a1e3904f2ab44c292604d0e49e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:23.814417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f65a4a1e3904f2ab44c292604d0e49e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:23.816338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:23.862248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:23.863834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f65a4a1e3904f2ab44c292604d0e49e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.864678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f65a4a1e3904f2ab44c292604d0e49e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.865616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f65a4a1e3904f2ab44c292604d0e49e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.873889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f65a4a1e3904f2ab44c292604d0e49e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.886626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f65a4a1e3904f2ab44c292604d0e49e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:23.900800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1069/2144] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:23 2022] DELETE /identity/v3/users/0f65a4a1e3904f2ab44c292604d0e49e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:24.291807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:24.294388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:24.311123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1df467-eb16-4bde-96bf-d388d58660e1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:24.373396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:24.374270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:24.374584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:24.374885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] PATH_INFO: `/v3/projects/b3a5f989ae9d4a3fb26b54e0653aa42f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:24.377047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a5f989ae9d4a3fb26b54e0653aa42f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:24.378992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:24.423497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:24.430383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a5f989ae9d4a3fb26b54e0653aa42f', 'request_id': 'req-8dd96648-4de3-4d86-b973-19c36ceb10a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.438913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a5f989ae9d4a3fb26b54e0653aa42f', 'request_id': 'req-8dd96648-4de3-4d86-b973-19c36ceb10a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.444860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a5f989ae9d4a3fb26b54e0653aa42f', 'request_id': 'req-8dd96648-4de3-4d86-b973-19c36ceb10a1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.456148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] The token cache is being invalidate because project b3a5f989ae9d4a3fb26b54e0653aa42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:24.456437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.457104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.458664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1076/2145] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:24 2022] DELETE /identity/v3/projects/b3a5f989ae9d4a3fb26b54e0653aa42f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:24.463186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:24.464884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:24.478487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781cf41-2089-4d6e-a21c-2b6a827fef4f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:24.539811 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:24.540700 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:24.540984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:24.541298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] PATH_INFO: `/v3/users/ba370c4d68d84532bfb462b436fed02c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:24.542652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba370c4d68d84532bfb462b436fed02c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:24.544670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:24.599032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba370c4d68d84532bfb462b436fed02c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.599752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba370c4d68d84532bfb462b436fed02c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.600353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba370c4d68d84532bfb462b436fed02c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.608254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba370c4d68d84532bfb462b436fed02c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.621854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3979f3a5-7cd9-4c2e-8883-dd5b61f76f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba370c4d68d84532bfb462b436fed02c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:24.638857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1070/2146] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:24 2022] DELETE /identity/v3/users/ba370c4d68d84532bfb462b436fed02c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:24.946772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:24.948737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:24.962045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96648-4de3-4d86-b973-19c36ceb10a1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.039241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.040155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.040433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.040706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] PATH_INFO: `/v3/projects/245e21070dea402cbcf771612ac167e8` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.041941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] RBAC: Authorizing `identity:delete_project(project_id=245e21070dea402cbcf771612ac167e8)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.043842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.094634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245e21070dea402cbcf771612ac167e8', 'request_id': 'req-2966c6ba-1555-4ff0-be68-969fa550980a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:25.105250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245e21070dea402cbcf771612ac167e8', 'request_id': 'req-2966c6ba-1555-4ff0-be68-969fa550980a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:25.111550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245e21070dea402cbcf771612ac167e8', 'request_id': 'req-2966c6ba-1555-4ff0-be68-969fa550980a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:25.122888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] The token cache is being invalidate because project 245e21070dea402cbcf771612ac167e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:25.123175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:25.123928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2966c6ba-1555-4ff0-be68-969fa550980a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:25.126038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1077/2147] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:24 2022] DELETE /identity/v3/projects/245e21070dea402cbcf771612ac167e8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:25.134912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.135210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.135483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.154568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:25.155785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:25.196612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:25.223950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1071/2148] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:25.232844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.233162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.233440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.253158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:25.254310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:25.262454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1078/2149] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:25.266688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.276980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8da3d-3a21-4b9c-9683-56c97bd596aa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.282087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.282791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.283066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.283338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.284214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:25.284523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.286190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.299401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1072/2150] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:13:25.303954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.322264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691840c-76c4-4d29-bb83-3f84859abf12 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.329959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.331424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.331590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.331851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.333701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.335737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.363087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1079/2151] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:25 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:25.367311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.378052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51698-ff6e-4617-96c9-4fd2dc7b51f6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.434040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.434728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.435009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.435276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.435972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.437980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.461423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1073/2152] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:25 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:25.465923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.477946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7218ec-0b2c-463e-af88-399771ce0c16 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.482478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.483139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.483421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.483696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.484429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.486119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.496721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1080/2153] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:25.501407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.512025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e976a-a8a0-4070-9d8a-af049d206df7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.516464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac974f-7627-4aaa-b078-65f10222d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.517141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac974f-7627-4aaa-b078-65f10222d83f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.517422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac974f-7627-4aaa-b078-65f10222d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.517696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac974f-7627-4aaa-b078-65f10222d83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.518429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac974f-7627-4aaa-b078-65f10222d83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.520022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac974f-7627-4aaa-b078-65f10222d83f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.530555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1074/2154] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:25.536183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.546460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a000-1781-4c91-9b22-e24b155b017c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.551290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.552181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.552449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.552718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] PATH_INFO: `/v3/projects/01f471802c1e4d5393928e42b59b2962/users/f75d5fe118b348098ac701778e552da7/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.569197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f471802c1e4d5393928e42b59b2962, user_id=f75d5fe118b348098ac701778e552da7, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.571888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.575056 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:25.591392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1081/2155] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:25 2022] PUT /identity/v3/projects/01f471802c1e4d5393928e42b59b2962/users/f75d5fe118b348098ac701778e552da7/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:25.596817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067e37-97c7-4727-a86a-fc589938ef0d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.597158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067e37-97c7-4727-a86a-fc589938ef0d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.597469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067e37-97c7-4727-a86a-fc589938ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.618064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-24067e37-97c7-4727-a86a-fc589938ef0d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:25.619296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-24067e37-97c7-4727-a86a-fc589938ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:25.684258 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1075/2156] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:25.694456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:25.696633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:25.757263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd0fc4-1393-47a5-b3a7-eaf16ab4541f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:25.761979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:25.762719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:25.762912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:25.763206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:25.773355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:25.774806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:25.784734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1082/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:30.384110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.385001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.385915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.421131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] MFA Rules not processed for user `f75d5fe118b348098ac701778e552da7`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:30.422695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:30.472301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:30.516885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1076/2158] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:30.521586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:30.531684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ec7bd-3197-4405-9943-6e83f40403ea service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:30.537585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:30.538247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.538533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.538811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.539525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:30.541641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:30.573044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1083/2159] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:30 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:13:30.575547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:30.587347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10019b5b-7d9e-4b3f-a26d-e32435ff6050 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:30.647201 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:30.647895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.648165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.648445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.649203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:30.651118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:30.674809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1077/2160] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:30 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:13:30.678796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:30.690144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20dde-01ba-453b-b4c9-e427a74c6ba9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:30.695688 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:30.696391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.696862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.697293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.698178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:30.700028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:30.712331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1084/2161] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:30.716422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:30.727646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600438f-0e32-4bbd-9170-fe94a338faf3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:30.732418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:30.733363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.733673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.733955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] PATH_INFO: `/v3/projects/266edb9ac8ab4ecfa249c2bc28af860c/users/828a3e4cae9c4ed1b1a0ca3e7adcf792/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.755576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=266edb9ac8ab4ecfa249c2bc28af860c, user_id=828a3e4cae9c4ed1b1a0ca3e7adcf792, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:30.758466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:30.773866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1078/2162] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:30 2022] PUT /identity/v3/projects/266edb9ac8ab4ecfa249c2bc28af860c/users/828a3e4cae9c4ed1b1a0ca3e7adcf792/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:30.778231 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:30.788843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fec6cd-1b4d-409e-9ebf-d3603d7222c1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:30.854132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156772-fa02-423f-a33b-8a104d2bd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:30.854855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156772-fa02-423f-a33b-8a104d2bd885 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.855137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156772-fa02-423f-a33b-8a104d2bd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.855420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156772-fa02-423f-a33b-8a104d2bd885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.856161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156772-fa02-423f-a33b-8a104d2bd885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:30.857832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156772-fa02-423f-a33b-8a104d2bd885 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:30.868295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1085/2163] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:30.872691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:30.884048 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b141-79dd-4127-b2b8-7842202486ea admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:30.889199 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:30.890130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:30.890409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:30.890742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] PATH_INFO: `/v3/projects/266edb9ac8ab4ecfa249c2bc28af860c/users/828a3e4cae9c4ed1b1a0ca3e7adcf792/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:30.893192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=266edb9ac8ab4ecfa249c2bc28af860c, user_id=828a3e4cae9c4ed1b1a0ca3e7adcf792, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:30.895854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:30.907315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1079/2164] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:30 2022] PUT /identity/v3/projects/266edb9ac8ab4ecfa249c2bc28af860c/users/828a3e4cae9c4ed1b1a0ca3e7adcf792/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:39.191765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07037f-cde6-4258-9949-9bb03e3a0659 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:39.192254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07037f-cde6-4258-9949-9bb03e3a0659 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:39.192356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07037f-cde6-4258-9949-9bb03e3a0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:39.223940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6a07037f-cde6-4258-9949-9bb03e3a0659 None None] MFA Rules not processed for user `828a3e4cae9c4ed1b1a0ca3e7adcf792`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:39.225394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6a07037f-cde6-4258-9949-9bb03e3a0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:39.297447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:39.324937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1086/2165] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:39.338903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:39.340714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:39.427372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781278-9dfc-4fb6-9a35-7f81349f75fd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:39.433826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a10f4-ee0c-4565-bb4c-0eb8caa9fad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:39.434494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a10f4-ee0c-4565-bb4c-0eb8caa9fad9 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:39.434777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a10f4-ee0c-4565-bb4c-0eb8caa9fad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:39.435088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a10f4-ee0c-4565-bb4c-0eb8caa9fad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:39.464209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:39.501909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a10f4-ee0c-4565-bb4c-0eb8caa9fad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:39.503573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a10f4-ee0c-4565-bb4c-0eb8caa9fad9 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:39.517622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1080/2166] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:40.860912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2b211-2844-4f58-9192-08bfa4a338c8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:40.861449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2b211-2844-4f58-9192-08bfa4a338c8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:40.861651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2b211-2844-4f58-9192-08bfa4a338c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:40.881057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a3b2b211-2844-4f58-9192-08bfa4a338c8 None None] MFA Rules not processed for user `f75d5fe118b348098ac701778e552da7`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:40.882843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a3b2b211-2844-4f58-9192-08bfa4a338c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:40.891497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1087/2167] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:41.857753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503cb13-2234-4331-bdfd-929bbc6334e3 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:41.858651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503cb13-2234-4331-bdfd-929bbc6334e3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:41.859106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503cb13-2234-4331-bdfd-929bbc6334e3 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:41.861852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1081/2168] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:13:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:13:41.913667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:41.914180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:41.914800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:41.998067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:42.007936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503cb13-2234-4331-bdfd-929bbc6334e3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:42.011483 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a503cb13-2234-4331-bdfd-929bbc6334e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:42.024401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:42.189276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503cb13-2234-4331-bdfd-929bbc6334e3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:42.193969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1088/2169] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:42.197265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:42.200183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:42.200667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:42.201397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] PATH_INFO: `/v3/users/bc103ff7fb9342179a7ce6404315afed` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:42.205879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc103ff7fb9342179a7ce6404315afed)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:42.207528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:42.208393 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:42.209227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:42.239214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0c267-1d09-465d-b764-11ddc40ffeae None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:42.257281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:42.258743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:42.259484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:42.259794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:42.271321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:42.273429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:42.291204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1089/2170] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:13:42.300368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc103ff7fb9342179a7ce6404315afed'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.301721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc103ff7fb9342179a7ce6404315afed'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.303200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc103ff7fb9342179a7ce6404315afed'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.312094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc103ff7fb9342179a7ce6404315afed'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.348545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ba5467b6-ad92-4e41-8a87-09e6950ee191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc103ff7fb9342179a7ce6404315afed'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.363919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1082/2171] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:42 2022] DELETE /identity/v3/users/bc103ff7fb9342179a7ce6404315afed => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:42.636469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:42.649560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04b315-febf-4853-af54-9ff08aee7448 service placement] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:42.733570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:42.734471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:42.734779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:42.735146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] PATH_INFO: `/v3/projects/3f90a27e69c7441ea20216b40281fdba` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:42.736452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f90a27e69c7441ea20216b40281fdba)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:42.738420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:42.796856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f90a27e69c7441ea20216b40281fdba', 'request_id': 'req-987d4593-459d-491f-9654-7d804de07b40'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.804959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f90a27e69c7441ea20216b40281fdba', 'request_id': 'req-987d4593-459d-491f-9654-7d804de07b40'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.811195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f90a27e69c7441ea20216b40281fdba', 'request_id': 'req-987d4593-459d-491f-9654-7d804de07b40'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.812271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.825569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] The token cache is being invalidate because project 3f90a27e69c7441ea20216b40281fdba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:42.825878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.826630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-987d4593-459d-491f-9654-7d804de07b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:42.828381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1090/2172] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:42 2022] DELETE /identity/v3/projects/3f90a27e69c7441ea20216b40281fdba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:42.834104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:42.834402 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:42.834676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:42.854580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:42.856866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:42.902630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:42.928869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1083/2173] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:42.937458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:42.938010 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:42.938133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:42.958085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:42.959330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:42.967741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1091/2174] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:42.972122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:42.982736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c4e8-9841-49ed-94fb-f81360d633b9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:42.987580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:42.988263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:42.988547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:42.988859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:42.989758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:42.990096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:42.991704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.006866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1084/2175] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:13:43.011538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:43.021510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e29b5-3ce4-43dd-be99-9da41573ff67 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:43.026183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:43.026852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.027135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.027411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.028302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:43.031811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.070558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1092/2176] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:43 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:43.076685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:43.089146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3d4c-ee27-47a2-979b-0c1768462149 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:43.173749 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:43.174533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.174983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.175209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.176355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:43.178192 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.203170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1085/2177] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:43 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:13:43.207268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:43.231229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4b1a-f599-4048-8478-aa7c3f3af0e0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:43.238240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:43.238920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.239504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.239777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.240522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:43.242374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.257573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1093/2178] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:43.261646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:43.272251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50acc-71a6-4306-8fbc-c5027e3152ab admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:43.276971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ef44c-57ca-4308-aae0-d0ef82c5f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:43.277693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ef44c-57ca-4308-aae0-d0ef82c5f993 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.277995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ef44c-57ca-4308-aae0-d0ef82c5f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.278256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ef44c-57ca-4308-aae0-d0ef82c5f993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.279009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ef44c-57ca-4308-aae0-d0ef82c5f993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:43.281827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ef44c-57ca-4308-aae0-d0ef82c5f993 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.292931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1086/2179] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:43.297170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:43.307669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d742-d9be-4c23-a6c9-e01ab12c3862 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:43.313473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:43.314511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.314810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.315092 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] PATH_INFO: `/v3/projects/c22cd26ffe194abc9dbb794acb48a4d0/users/b8c49ea93c79464c846988c205704ac8/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.333237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22cd26ffe194abc9dbb794acb48a4d0, user_id=b8c49ea93c79464c846988c205704ac8, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:43.335993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.353370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1094/2180] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:43 2022] PUT /identity/v3/projects/c22cd26ffe194abc9dbb794acb48a4d0/users/b8c49ea93c79464c846988c205704ac8/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:43.363646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87138d3-872b-4886-9e22-357dac758d88 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.363942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87138d3-872b-4886-9e22-357dac758d88 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.364275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87138d3-872b-4886-9e22-357dac758d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.401296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b87138d3-872b-4886-9e22-357dac758d88 None None] MFA Rules not processed for user `b8c49ea93c79464c846988c205704ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:43.402855 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b87138d3-872b-4886-9e22-357dac758d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:43.493170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1087/2181] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:43.504203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:43.505992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:43.593684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e487c-06b1-4063-9de2-46b057fa7395 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:43.599772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:43.600637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:43.600921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:43.601232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:43.611252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:43.613125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:43.622540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1095/2182] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:48.138592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c467ac-ee92-4565-9c5f-64a61395b82b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:48.139104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c467ac-ee92-4565-9c5f-64a61395b82b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:48.139191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c467ac-ee92-4565-9c5f-64a61395b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:48.156988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a3c467ac-ee92-4565-9c5f-64a61395b82b None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:48.158221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a3c467ac-ee92-4565-9c5f-64a61395b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:48.197595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:48.215788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1088/2183] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:48.258865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:48.260428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:48.338583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7e327-d53f-415e-8040-43a1486aada1 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:48.344017 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:48.344672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:48.344957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:48.345265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:48.353944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:48.355530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:48.363610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1096/2184] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:48.914550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3640-38b1-42e3-80e6-07856e2112b9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:48.914845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3640-38b1-42e3-80e6-07856e2112b9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:48.915124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3640-38b1-42e3-80e6-07856e2112b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:48.933561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a2da3640-38b1-42e3-80e6-07856e2112b9 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:48.934766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a2da3640-38b1-42e3-80e6-07856e2112b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:48.942495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1089/2185] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jun 7 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:48.955043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:48.961778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:48.965992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a851-281c-459e-874a-93cf0e85e59a service swift] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:48.972291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:48.972941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:48.973248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:48.973521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:48.982320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:48.985315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:48.993928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1097/2186] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:49.211111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623213d-105c-417a-8fad-adc60c06dbcb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:49.211590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623213d-105c-417a-8fad-adc60c06dbcb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:49.211685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623213d-105c-417a-8fad-adc60c06dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:49.230278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6623213d-105c-417a-8fad-adc60c06dbcb None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:49.231463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6623213d-105c-417a-8fad-adc60c06dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:49.239012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1090/2187] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:49.251729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:49.269706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b33e6-f225-4fd6-afdb-5e38d98c2aca service swift] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:49.276459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:49.277168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:49.277448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:49.277719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:49.286876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:49.288470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:49.299046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1098/2188] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:49.632736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:49.633038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:49.633320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:49.651814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:49.653044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:49.660367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1091/2189] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jun 7 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:49.672588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:49.683471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba8b30-d01b-406f-9a37-da5007a03715 service swift] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:49.688752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843d15-7f1d-4519-b559-aed2c1122d02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:49.689425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843d15-7f1d-4519-b559-aed2c1122d02 service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:49.689737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843d15-7f1d-4519-b559-aed2c1122d02 service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:49.690008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843d15-7f1d-4519-b559-aed2c1122d02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:49.698608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843d15-7f1d-4519-b559-aed2c1122d02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:49.700189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843d15-7f1d-4519-b559-aed2c1122d02 service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:49.708968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1099/2190] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:54.992151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:54.994320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:55.164380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536196-58a0-4b43-904c-2e7927e7b378 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:55.171197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:55.172173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:55.172593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:55.172879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] PATH_INFO: `/v3/users/1935cd7481134d1087a2dac4cdeb9ced` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:55.174121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1935cd7481134d1087a2dac4cdeb9ced)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:55.176091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:55.235003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1935cd7481134d1087a2dac4cdeb9ced'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.235672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1935cd7481134d1087a2dac4cdeb9ced'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.236280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1935cd7481134d1087a2dac4cdeb9ced'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.245466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1935cd7481134d1087a2dac4cdeb9ced'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.254648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:55.260238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1935cd7481134d1087a2dac4cdeb9ced'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.278265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1092/2191] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:54 2022] DELETE /identity/v3/users/1935cd7481134d1087a2dac4cdeb9ced => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:55.279923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:55.280438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:55.280438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:55.314397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:55.315666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:55.387527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1100/2192] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:55.400272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:55.402271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:55.506352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481ff4-df00-49c8-8691-f9a9a71db43c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:55.511203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:55.511860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:55.512142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:55.512411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:55.522180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:55.523787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:55.533804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1093/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:55.730076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:55.731612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:55.745349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3aad6-64a7-4a83-9e65-be182dc1e511 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:55.750618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:55.751447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:55.751729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:55.751999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] PATH_INFO: `/v3/projects/fd3b1d809bab4a86ba53fa492ffa827d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:55.753644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3b1d809bab4a86ba53fa492ffa827d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:55.755255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:55.806402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3b1d809bab4a86ba53fa492ffa827d', 'request_id': 'req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.815005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3b1d809bab4a86ba53fa492ffa827d', 'request_id': 'req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.820743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3b1d809bab4a86ba53fa492ffa827d', 'request_id': 'req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.833005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] The token cache is being invalidate because project fd3b1d809bab4a86ba53fa492ffa827d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:55.833452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.834122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-6457d023-ab68-4089-b8e6-5f24b9ae2fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:55.835709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1101/2194] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:55 2022] DELETE /identity/v3/projects/fd3b1d809bab4a86ba53fa492ffa827d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:56.241919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:56.242779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:56.255947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92371-165e-4d99-890f-fe689cf000aa service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:56.330653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:56.331942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:56.332384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:56.332728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] PATH_INFO: `/v3/users/b8c49ea93c79464c846988c205704ac8` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:56.334324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c49ea93c79464c846988c205704ac8)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:56.337372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:56.412244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c49ea93c79464c846988c205704ac8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:56.413586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c49ea93c79464c846988c205704ac8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:56.414740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c49ea93c79464c846988c205704ac8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:56.422278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:56.427221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c49ea93c79464c846988c205704ac8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:56.445290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c49ea93c79464c846988c205704ac8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:56.464899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1094/2195] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:56 2022] DELETE /identity/v3/users/b8c49ea93c79464c846988c205704ac8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:56.471243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:56.471981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:56.472377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:56.491865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:56.493394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:56.560043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:56.590651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1102/2196] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:56.600728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:56.602561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:56.669188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a020-143c-4898-bb5d-1152d3c2a1e1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:56.673774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac328a0-fae9-4eab-a6c0-ccccfe968d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:56.674424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac328a0-fae9-4eab-a6c0-ccccfe968d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:56.674710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac328a0-fae9-4eab-a6c0-ccccfe968d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:56.674974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac328a0-fae9-4eab-a6c0-ccccfe968d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:56.685507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac328a0-fae9-4eab-a6c0-ccccfe968d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:56.686968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac328a0-fae9-4eab-a6c0-ccccfe968d3f service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:56.697312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1095/2197] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:13:57.004859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.006367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:57.019108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74618a8-6cc5-4c45-8d68-5f62e8f690fa None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.023725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.024621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.024900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.025202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] PATH_INFO: `/v3/projects/c22cd26ffe194abc9dbb794acb48a4d0` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.026396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22cd26ffe194abc9dbb794acb48a4d0)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.028331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.088857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22cd26ffe194abc9dbb794acb48a4d0', 'request_id': 'req-2d90bbf0-a332-4918-bdb0-78c9200db84d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:57.098629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22cd26ffe194abc9dbb794acb48a4d0', 'request_id': 'req-2d90bbf0-a332-4918-bdb0-78c9200db84d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:57.104469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22cd26ffe194abc9dbb794acb48a4d0', 'request_id': 'req-2d90bbf0-a332-4918-bdb0-78c9200db84d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:57.116930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] The token cache is being invalidate because project c22cd26ffe194abc9dbb794acb48a4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:57.117257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:57.118016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2d90bbf0-a332-4918-bdb0-78c9200db84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:57.119888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1103/2198] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:57 2022] DELETE /identity/v3/projects/c22cd26ffe194abc9dbb794acb48a4d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:57.124549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.125312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.125651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.164276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:57.165928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:57.232718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1096/2199] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:57.240107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.240472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.240793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.260504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:57.261768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:57.270310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1104/2200] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:57.275451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.286913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfdaf1-aa23-46d5-9f63-acca24ef26bc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.292286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.293131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.293406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.293681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.294418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:13:57.294725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.296333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.311288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1097/2201] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:13:57.315348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.325051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65da580-a47e-4657-a9d0-32ca36116957 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.330259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.330915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.331194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.331471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.332180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.334162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.362658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1105/2202] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:57.367015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.377896 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf959-c071-4074-841c-73b729726e25 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.425771 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:57.443508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.444208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.444546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.444813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.445978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.447654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.469876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1098/2203] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:57.474051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.484462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189548c-d8ff-4f2f-b386-cd22ef1b319d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.489327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.489980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.490258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.490528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.491257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.493116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.503833 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1106/2204] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:13:57.507788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.518846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629517ac-0d73-40cd-8cff-80d75c565f22 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.524680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e933b9-c33c-44b4-9f6b-2b02fbf346cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.525381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e933b9-c33c-44b4-9f6b-2b02fbf346cd admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.525646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e933b9-c33c-44b4-9f6b-2b02fbf346cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.525952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e933b9-c33c-44b4-9f6b-2b02fbf346cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.526690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e933b9-c33c-44b4-9f6b-2b02fbf346cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.528335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e933b9-c33c-44b4-9f6b-2b02fbf346cd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.540062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1099/2205] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:57.544541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.555598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dd1c8-27e7-4ca7-9a5f-ff05db325444 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.560443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.561412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.561635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.561912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] PATH_INFO: `/v3/projects/60cf9a5750f44ac48ad46d721aad2fe7/users/3e029e75fb9c409a857d732afe4eb532/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.580965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cf9a5750f44ac48ad46d721aad2fe7, user_id=3e029e75fb9c409a857d732afe4eb532, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.583962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.599832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1107/2206] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:57 2022] PUT /identity/v3/projects/60cf9a5750f44ac48ad46d721aad2fe7/users/3e029e75fb9c409a857d732afe4eb532/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:13:57.611760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.612104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.612348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.641320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] MFA Rules not processed for user `3e029e75fb9c409a857d732afe4eb532`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:57.642751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:57.723898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1100/2207] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:57.728598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.793963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c911a6-082d-4e41-aff0-c7518c0d8431 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.800042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.800243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.800500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.800863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.801602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.803584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.808609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:57.835450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1108/2208] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:57.839867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.851839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662481d0-20dd-4ae4-92dc-048c93383c81 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.912004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.912692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.912975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.913355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.914069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.916189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.938667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1101/2209] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:13:57 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:13:57.943099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.954152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709e70a-6bea-49fa-b282-fefaafae53d5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.959067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:57.959746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:57.960027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:57.960308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:57.961125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:57.962801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:57.974102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1109/2210] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:57.978792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:57.993822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebfe05-df4a-4a33-9172-409f2464c5c2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:57.999222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:58.000482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.000760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.001041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] PATH_INFO: `/v3/projects/88fcd71dc79c409aa08cc7b4045b0b49/users/4864202bea71426dab41d5f1a83645f3/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.018022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fcd71dc79c409aa08cc7b4045b0b49, user_id=4864202bea71426dab41d5f1a83645f3, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:58.020714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:58.036895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1102/2211] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:57 2022] PUT /identity/v3/projects/88fcd71dc79c409aa08cc7b4045b0b49/users/4864202bea71426dab41d5f1a83645f3/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:58.041069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:58.051161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02cb4-e3f4-41b6-b883-b30013bfc511 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:58.109359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d7050-0015-401d-b6cc-2d3fc5947f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:58.110041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d7050-0015-401d-b6cc-2d3fc5947f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.110324 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d7050-0015-401d-b6cc-2d3fc5947f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.110597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d7050-0015-401d-b6cc-2d3fc5947f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.111330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d7050-0015-401d-b6cc-2d3fc5947f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:58.112933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d7050-0015-401d-b6cc-2d3fc5947f96 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:58.123759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1110/2212] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:13:58.129059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:58.141044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fd6d3-79a1-4448-833a-961bdd7e040b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:58.145881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:58.146829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.147144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.147417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] PATH_INFO: `/v3/projects/88fcd71dc79c409aa08cc7b4045b0b49/users/4864202bea71426dab41d5f1a83645f3/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.149558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fcd71dc79c409aa08cc7b4045b0b49, user_id=4864202bea71426dab41d5f1a83645f3, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:58.152236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:58.163431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1103/2213] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:13:58 2022] PUT /identity/v3/projects/88fcd71dc79c409aa08cc7b4045b0b49/users/4864202bea71426dab41d5f1a83645f3/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:58.174649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.174954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.175226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.206378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] MFA Rules not processed for user `4864202bea71426dab41d5f1a83645f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:58.207622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:58.309428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1111/2214] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:13:58.323524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:58.325364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:58.337947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:58.398112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac33de-ea68-474d-8204-afd421d39de1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:58.402704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfd387-dcd3-4d9b-93e5-c3982442ca6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:58.403376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfd387-dcd3-4d9b-93e5-c3982442ca6e service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.403667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfd387-dcd3-4d9b-93e5-c3982442ca6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.403940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfd387-dcd3-4d9b-93e5-c3982442ca6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.415464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfd387-dcd3-4d9b-93e5-c3982442ca6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:58.416917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfd387-dcd3-4d9b-93e5-c3982442ca6e service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:58.428539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1104/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:58.596408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:58.666435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:58.673584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e4a0-c318-4f13-bb79-75ec91952d60 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:58.681961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:58.682862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.683147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.683422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] PATH_INFO: `/v3/users/3e029e75fb9c409a857d732afe4eb532` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.684676 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e029e75fb9c409a857d732afe4eb532)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:58.686787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:58.741890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e029e75fb9c409a857d732afe4eb532'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:58.742580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e029e75fb9c409a857d732afe4eb532'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:58.743267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e029e75fb9c409a857d732afe4eb532'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:58.752075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e029e75fb9c409a857d732afe4eb532'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:58.765508 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e029e75fb9c409a857d732afe4eb532'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:58.780670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1112/2216] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:58 2022] DELETE /identity/v3/users/3e029e75fb9c409a857d732afe4eb532 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:58.785320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.785703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.786041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.804299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:13:58.805784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:58.866743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1105/2217] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:13:58.877187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:58.878750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:58.939191 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21addb1-d01c-4989-9d5f-400437057f25 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:58.943397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:58.944052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:58.944327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:58.944593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:58.957307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:58.959404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:58.974818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1113/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:13:59.660257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:59.661926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:13:59.674316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f3ab-c41b-4e97-b63d-afcc13632d81 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:59.679574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:59.680598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:59.680974 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:59.681651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] PATH_INFO: `/v3/projects/60cf9a5750f44ac48ad46d721aad2fe7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:59.683032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cf9a5750f44ac48ad46d721aad2fe7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:59.685006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:59.748428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cf9a5750f44ac48ad46d721aad2fe7', 'request_id': 'req-7f6950cc-7bb8-4217-a1b3-cd0101df405c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.756904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cf9a5750f44ac48ad46d721aad2fe7', 'request_id': 'req-7f6950cc-7bb8-4217-a1b3-cd0101df405c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.763055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cf9a5750f44ac48ad46d721aad2fe7', 'request_id': 'req-7f6950cc-7bb8-4217-a1b3-cd0101df405c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.774992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] The token cache is being invalidate because project 60cf9a5750f44ac48ad46d721aad2fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:13:59.774992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.775643 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.777372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1106/2219] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:13:59 2022] DELETE /identity/v3/projects/60cf9a5750f44ac48ad46d721aad2fe7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:13:59.781359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:13:59.791534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a8e8-62e0-4be3-a4d5-8e8911efdf7f service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:13:59.858912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:13:59.859874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:13:59.860152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:13:59.860495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] PATH_INFO: `/v3/users/4864202bea71426dab41d5f1a83645f3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:13:59.861779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4864202bea71426dab41d5f1a83645f3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:13:59.863764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:13:59.890393 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:59.928905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4864202bea71426dab41d5f1a83645f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.929719 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4864202bea71426dab41d5f1a83645f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.930461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4864202bea71426dab41d5f1a83645f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.942064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4864202bea71426dab41d5f1a83645f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.955796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-da04fa3f-bf6c-4e48-b19e-a0e898e5e6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4864202bea71426dab41d5f1a83645f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:13:59.969872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1114/2220] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:13:59 2022] DELETE /identity/v3/users/4864202bea71426dab41d5f1a83645f3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:00.258198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.260182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:00.277922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6950cc-7bb8-4217-a1b3-cd0101df405c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.317763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:00.348417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.349332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.349617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.349890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] PATH_INFO: `/v3/projects/88fcd71dc79c409aa08cc7b4045b0b49` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.351189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fcd71dc79c409aa08cc7b4045b0b49)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.353881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.405563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fcd71dc79c409aa08cc7b4045b0b49', 'request_id': 'req-3247564b-f72b-4403-8a64-5649ec96ad5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:00.425503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fcd71dc79c409aa08cc7b4045b0b49', 'request_id': 'req-3247564b-f72b-4403-8a64-5649ec96ad5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:00.435128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fcd71dc79c409aa08cc7b4045b0b49', 'request_id': 'req-3247564b-f72b-4403-8a64-5649ec96ad5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:00.451536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] The token cache is being invalidate because project 88fcd71dc79c409aa08cc7b4045b0b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:14:00.451941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:00.456777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3247564b-f72b-4403-8a64-5649ec96ad5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:00.459443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1107/2221] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:14:00 2022] DELETE /identity/v3/projects/88fcd71dc79c409aa08cc7b4045b0b49 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:00.466305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.466628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.466902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.490671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:00.492048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:00.560603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1115/2222] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:00.569528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.569803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.570076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.594829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:00.596079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:00.604893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1108/2223] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:00.609155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.622947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfd506-1003-493d-95a3-00cb04833ec9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.630683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.631420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.631765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.632153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.633086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:14:00.633401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.635398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.654129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1116/2224] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:14:00.655392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.665703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f842a-f113-49a6-a743-d109c8e1b816 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.672266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.672950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.673260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.673534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.674259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.676203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.710341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1109/2225] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:14:00 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:00.715044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.728237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20aa9c-a2b1-43d9-a3e4-c01f9b93f0e5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.812762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.813625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.813625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.813918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.814572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.817029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.842099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1117/2226] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:14:00 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:00.846532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.858950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31491143-5e18-4970-9378-755a909d5f58 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.864951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.865654 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.865935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.866332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.867184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.869003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.883214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1110/2227] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:00.887749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.899332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875591-42c2-4f22-ba71-1929590542eb admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.905716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a8ea-59be-401a-8512-91e269093323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.906413 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a8ea-59be-401a-8512-91e269093323 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.906695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a8ea-59be-401a-8512-91e269093323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.907700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a8ea-59be-401a-8512-91e269093323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.908905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a8ea-59be-401a-8512-91e269093323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.911433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a8ea-59be-401a-8512-91e269093323 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.932706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1118/2228] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:14:00.937277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:00.948043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e346-9f0e-4a0f-942a-c514ec8c018d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:00.953559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:00.954604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:00.954921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:00.955255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] PATH_INFO: `/v3/projects/a74403e1f4a54ad7b65b2b7d51eac074/users/b95e0074cd22443e90106ee7724891fe/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:00.973024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74403e1f4a54ad7b65b2b7d51eac074, user_id=b95e0074cd22443e90106ee7724891fe, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:00.975850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:00.993711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1111/2229] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:00 2022] PUT /identity/v3/projects/a74403e1f4a54ad7b65b2b7d51eac074/users/b95e0074cd22443e90106ee7724891fe/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:01.000469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575592-68ab-46ce-bbb1-e539e56f333d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:01.000929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575592-68ab-46ce-bbb1-e539e56f333d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:01.001437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575592-68ab-46ce-bbb1-e539e56f333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:01.011107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:01.024502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-c7575592-68ab-46ce-bbb1-e539e56f333d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:01.026622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c7575592-68ab-46ce-bbb1-e539e56f333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:01.097356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1119/2230] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:01.107648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:01.109469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:01.183203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90f8f-3744-4944-8bcc-8a64f5d8761d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:01.186909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:01.187547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:01.187837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:01.188113 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:01.202338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:01.203969 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:01.216142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1112/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:14:02.062474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.063504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.063828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.119539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] MFA Rules not processed for user `b95e0074cd22443e90106ee7724891fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:02.125849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:02.220033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1120/2232] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:02.224505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:02.229624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:02.236491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425773f-5187-457b-908e-8ce19a16bde4 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:02.244195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:02.245083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.245375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.245649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.246367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:02.248308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:02.275356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1113/2233] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:14:02 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:02.279609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:02.290574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09222935-9a2d-4fdf-9369-4e57f45e5c0f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:02.347503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:02.348183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.348462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.348732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.349480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:02.351399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:02.375260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1121/2234] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:14:02 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:14:02.379307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:02.391951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa9de-6925-4ed2-87dd-51ac9e9b248b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:02.397123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:02.397826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.398110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.398530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.399406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:02.401465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:02.412999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1114/2235] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:02.417403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:02.429669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbb7e-5423-41e5-a154-6da5be9937e6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:02.434992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:02.435884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.436146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.436418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] PATH_INFO: `/v3/projects/8df6914c30ee4d89b8071d22820a8203/users/0738a12b6e9949bda65cf929cdeb6c65/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.453654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df6914c30ee4d89b8071d22820a8203, user_id=0738a12b6e9949bda65cf929cdeb6c65, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:02.456549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:02.467918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:02.477481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1122/2236] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:02 2022] PUT /identity/v3/projects/8df6914c30ee4d89b8071d22820a8203/users/0738a12b6e9949bda65cf929cdeb6c65/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:02.479188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:02.489495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3025fc-20b5-407a-9ee0-4c1e348146ad admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:02.552885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03fcb4-3b3f-4500-8212-c35214ceeca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:02.553669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03fcb4-3b3f-4500-8212-c35214ceeca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.553955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03fcb4-3b3f-4500-8212-c35214ceeca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.554231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03fcb4-3b3f-4500-8212-c35214ceeca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.554978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03fcb4-3b3f-4500-8212-c35214ceeca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:02.556783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03fcb4-3b3f-4500-8212-c35214ceeca0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:02.567151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1115/2237] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:02.571617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:02.585655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5eb7f-b5e0-4b6d-94b4-63aaa63f38b9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:02.590591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed5fa7-95a1-4f62-a637-b922c2ca6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:02.591485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed5fa7-95a1-4f62-a637-b922c2ca6660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:02.591765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed5fa7-95a1-4f62-a637-b922c2ca6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:02.592038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed5fa7-95a1-4f62-a637-b922c2ca6660 admin admin] PATH_INFO: `/v3/projects/8df6914c30ee4d89b8071d22820a8203/users/0738a12b6e9949bda65cf929cdeb6c65/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:02.594002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed5fa7-95a1-4f62-a637-b922c2ca6660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df6914c30ee4d89b8071d22820a8203, user_id=0738a12b6e9949bda65cf929cdeb6c65, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:02.596680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed5fa7-95a1-4f62-a637-b922c2ca6660 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:02.607383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1123/2238] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:02 2022] PUT /identity/v3/projects/8df6914c30ee4d89b8071d22820a8203/users/0738a12b6e9949bda65cf929cdeb6c65/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:03.285073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfe8cf-a165-4b2c-88b8-27f6ae684d83 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:03.285633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfe8cf-a165-4b2c-88b8-27f6ae684d83 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:03.286212 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfe8cf-a165-4b2c-88b8-27f6ae684d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:03.325987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-17cfe8cf-a165-4b2c-88b8-27f6ae684d83 None None] MFA Rules not processed for user `0738a12b6e9949bda65cf929cdeb6c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:03.327294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-17cfe8cf-a165-4b2c-88b8-27f6ae684d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:03.421657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1116/2239] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:14:04.517686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e29f8-bed8-4c34-9393-844cb1b9b969 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:04.518235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e29f8-bed8-4c34-9393-844cb1b9b969 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:04.518235 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e29f8-bed8-4c34-9393-844cb1b9b969 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:04.519559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1124/2240] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 13:14:04.555085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:04.555648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:04.555648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:04.575747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] MFA Rules not processed for user `d775aea1464a40e2887ed69c25a34f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:04.577596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:04.595302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e29f8-bed8-4c34-9393-844cb1b9b969 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:04.641311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:04.662768 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1117/2241] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:14:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:04.675079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:04.675633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:04.679533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e29f8-bed8-4c34-9393-844cb1b9b969 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:04.684335 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:04.685317 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:04.685597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:04.685869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] PATH_INFO: `/v3/users/b95e0074cd22443e90106ee7724891fe` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:04.687054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95e0074cd22443e90106ee7724891fe)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:04.688697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410edd-5cbf-40b3-ad45-e7552966fde5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:04.688970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:04.693757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:04.694405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:04.694688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:04.694967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:04.704125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:04.705737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:04.716102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1118/2242] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:14:04.747097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95e0074cd22443e90106ee7724891fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:04.747822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95e0074cd22443e90106ee7724891fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:04.748442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95e0074cd22443e90106ee7724891fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:04.756277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95e0074cd22443e90106ee7724891fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:04.771134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95e0074cd22443e90106ee7724891fe'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:04.786042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1125/2243] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:14:04 2022] DELETE /identity/v3/users/b95e0074cd22443e90106ee7724891fe => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:05.023437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:05.034709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62346-98e2-48bb-8b00-f95b1fc1b114 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:05.119091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:05.119981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.120267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.120541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] PATH_INFO: `/v3/projects/a74403e1f4a54ad7b65b2b7d51eac074` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.121778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74403e1f4a54ad7b65b2b7d51eac074)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:05.123685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:05.173838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74403e1f4a54ad7b65b2b7d51eac074', 'request_id': 'req-c18e458c-0246-49a9-b8ec-1642f7d54cce'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.183418 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74403e1f4a54ad7b65b2b7d51eac074', 'request_id': 'req-c18e458c-0246-49a9-b8ec-1642f7d54cce'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.189357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74403e1f4a54ad7b65b2b7d51eac074', 'request_id': 'req-c18e458c-0246-49a9-b8ec-1642f7d54cce'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.201070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] The token cache is being invalidate because project a74403e1f4a54ad7b65b2b7d51eac074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:14:05.201365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.202085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.203859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1119/2244] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:14:05 2022] DELETE /identity/v3/projects/a74403e1f4a54ad7b65b2b7d51eac074 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:05.208269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:05.209930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:05.224425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94ce0-4518-43d3-9426-ecca05c71f64 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:05.283366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:05.284449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.284732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.285035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] PATH_INFO: `/v3/users/0738a12b6e9949bda65cf929cdeb6c65` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.286423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0738a12b6e9949bda65cf929cdeb6c65)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:05.288426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:05.295905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:05.348722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0738a12b6e9949bda65cf929cdeb6c65'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.349463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0738a12b6e9949bda65cf929cdeb6c65'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.350246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0738a12b6e9949bda65cf929cdeb6c65'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.359314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0738a12b6e9949bda65cf929cdeb6c65'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.373405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4a7c4111-c9a8-4f1d-91cf-affadbd49326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0738a12b6e9949bda65cf929cdeb6c65'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.394182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1126/2245] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:14:05 2022] DELETE /identity/v3/users/0738a12b6e9949bda65cf929cdeb6c65 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:05.568852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:05.570376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:05.584221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e458c-0246-49a9-b8ec-1642f7d54cce admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:05.646136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:05.647009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.647287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.647595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] PATH_INFO: `/v3/projects/8df6914c30ee4d89b8071d22820a8203` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.648752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df6914c30ee4d89b8071d22820a8203)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:05.650892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:05.657140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:05.699985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df6914c30ee4d89b8071d22820a8203', 'request_id': 'req-74df4eb2-a7f3-46d0-b853-286d7b3da058'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.708194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df6914c30ee4d89b8071d22820a8203', 'request_id': 'req-74df4eb2-a7f3-46d0-b853-286d7b3da058'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.713984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df6914c30ee4d89b8071d22820a8203', 'request_id': 'req-74df4eb2-a7f3-46d0-b853-286d7b3da058'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.725788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] The token cache is being invalidate because project 8df6914c30ee4d89b8071d22820a8203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:14:05.726077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.726747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-74df4eb2-a7f3-46d0-b853-286d7b3da058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:05.728465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1120/2246] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:14:05 2022] DELETE /identity/v3/projects/8df6914c30ee4d89b8071d22820a8203 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:05.733540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.734027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.734137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.752838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:05.754069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:05.821811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1127/2247] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:05.830574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.830862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.831141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.862689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:05.863901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:05.873480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1121/2248] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:05.878142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:05.888039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb8114-dbec-47ab-a7bc-9b980192ac39 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:05.892757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:05.893438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.893743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.894015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.894749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:14:05.895058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:05.896609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:05.908968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1128/2249] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:14:05.913976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:05.923735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a555cf5-f1b4-49b8-a662-6e4954cde5f2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:05.930415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:05.931090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:05.931366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:05.931631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:05.932340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:05.934276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:05.964181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1122/2250] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:14:05 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:05.968580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:05.978664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008eb9a-59a2-430e-b1af-4ad75eae8fd3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.035557 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.036239 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.036499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.036797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.037551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.039479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.059750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1129/2251] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:14:05 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:14:06.063801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.074123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30eb9c-fbbf-4942-b527-6f30d41b35c0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.078648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.079292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.079569 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.079836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.080571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.082211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.094014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1123/2252] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:06.098669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.104246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:06.109845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3e70-319f-446b-a73f-3dd493748644 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.115363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba1a12-8371-4ab0-afe7-e2fe18c72a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.116034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba1a12-8371-4ab0-afe7-e2fe18c72a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.116543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba1a12-8371-4ab0-afe7-e2fe18c72a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.116837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba1a12-8371-4ab0-afe7-e2fe18c72a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.117781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba1a12-8371-4ab0-afe7-e2fe18c72a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.119616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba1a12-8371-4ab0-afe7-e2fe18c72a9f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.130021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1130/2253] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:06.134240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.144718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d706-fcb0-428d-93aa-8bb640174ea5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.150470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.151365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.151642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.151911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] PATH_INFO: `/v3/projects/28436684af7740ac953833c30a42f259/users/fdbf6d0e683744079c3e9bb116285e10/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.168981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28436684af7740ac953833c30a42f259, user_id=fdbf6d0e683744079c3e9bb116285e10, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.171694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.187376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1124/2254] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:06 2022] PUT /identity/v3/projects/28436684af7740ac953833c30a42f259/users/fdbf6d0e683744079c3e9bb116285e10/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:06.197993 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.198282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.198556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.227615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] MFA Rules not processed for user `fdbf6d0e683744079c3e9bb116285e10`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:06.228824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:06.299106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1131/2255] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:06.303824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.382514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33979b7-7f3d-461a-9aed-a57175ca1f9d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.388062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.388724 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.389006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.389314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.390014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.391926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.428017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1125/2256] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:14:06 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:06.434685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.449447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885f9b-b50f-4b81-8cd1-023c0a3075f1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.514250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.514927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.515205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.515491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.516220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.518173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.542212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1132/2257] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:14:06 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:06.546331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.557390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7892d-5a67-4bec-b246-41c02b52080b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.563397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.564074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.564360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.564635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.565454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.567073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.568342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:06.580243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1126/2258] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:06.585261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.596005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5131-4e9a-4b7c-8293-94d3b23daca0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.601372 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.602383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.603054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.603339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] PATH_INFO: `/v3/projects/2a4a89064e4045bea380344aa2e049cb/users/e826adf8cc5942f0a3e0347ba2f6a97f/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.619865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4a89064e4045bea380344aa2e049cb, user_id=e826adf8cc5942f0a3e0347ba2f6a97f, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.622575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.638329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1133/2259] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:06 2022] PUT /identity/v3/projects/2a4a89064e4045bea380344aa2e049cb/users/e826adf8cc5942f0a3e0347ba2f6a97f/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:06.642353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.653112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce21cb-ebee-4c5c-9358-91fa689fe261 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.721901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6533a8f-021c-4138-9ed3-955a63be89bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.722607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533a8f-021c-4138-9ed3-955a63be89bf admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.722869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533a8f-021c-4138-9ed3-955a63be89bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.723140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533a8f-021c-4138-9ed3-955a63be89bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.723910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6533a8f-021c-4138-9ed3-955a63be89bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.725528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6533a8f-021c-4138-9ed3-955a63be89bf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.736788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1127/2260] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:06.741215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.752856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15b88-f90d-445f-ba76-3604270478b8 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.760987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.761951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.762229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.762660 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] PATH_INFO: `/v3/projects/2a4a89064e4045bea380344aa2e049cb/users/e826adf8cc5942f0a3e0347ba2f6a97f/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.765005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4a89064e4045bea380344aa2e049cb, user_id=e826adf8cc5942f0a3e0347ba2f6a97f, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:06.767762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:06.780940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1134/2261] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:06 2022] PUT /identity/v3/projects/2a4a89064e4045bea380344aa2e049cb/users/e826adf8cc5942f0a3e0347ba2f6a97f/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:06.793033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.793403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.793876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.827819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] MFA Rules not processed for user `e826adf8cc5942f0a3e0347ba2f6a97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:06.829043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:06.905102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1128/2262] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:06.916403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:06.918244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:06.955057 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:06.982065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee44fbd-66cd-4c49-92a8-a521b7ccbe8c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:06.986036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b3f51-baf9-40bb-8f7e-3a9347860673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:06.986686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3f51-baf9-40bb-8f7e-3a9347860673 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:06.986970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3f51-baf9-40bb-8f7e-3a9347860673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:06.987232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3f51-baf9-40bb-8f7e-3a9347860673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:06.998624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b3f51-baf9-40bb-8f7e-3a9347860673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:07.000423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b3f51-baf9-40bb-8f7e-3a9347860673 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:07.010192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1135/2263] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:07.098055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:07.108568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032395c-6d35-47de-93a7-9d5532bb1c9c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:07.114422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:07.115263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:07.115672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:07.116053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:07.180519 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:07.181897 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:07.191184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1129/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:10.411652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:10.412349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:10.412437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:10.442768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:10.443964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:10.503226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1136/2265] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:14:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:10.515464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:10.517299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:10.536102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:10.603543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e686bb-abb8-4dab-af04-5fae7389c2c1 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:10.610581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dcc9e-5436-4d86-802b-de7487654352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:10.611248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcc9e-5436-4d86-802b-de7487654352 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:10.612054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcc9e-5436-4d86-802b-de7487654352 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:10.612054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcc9e-5436-4d86-802b-de7487654352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:10.622188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcc9e-5436-4d86-802b-de7487654352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:10.623838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcc9e-5436-4d86-802b-de7487654352 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:10.634692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1130/2266] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:14:20.495716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=40 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:20.630990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=25 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:22.555025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:22.556514 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:22.656049 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb617e-041a-4567-bbc1-3dce7721d6e2 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:22.661128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:22.662038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:22.662461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:22.662909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] PATH_INFO: `/v3/users/12c1c0a85b834811b8124b095aa00399` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:22.664145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c1c0a85b834811b8124b095aa00399)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:22.666141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:22.737671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c1c0a85b834811b8124b095aa00399'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:22.738582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c1c0a85b834811b8124b095aa00399'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:22.739263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c1c0a85b834811b8124b095aa00399'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:22.748419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c1c0a85b834811b8124b095aa00399'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:22.765460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c1c0a85b834811b8124b095aa00399'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:22.785085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1137/2267] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:14:22 2022] DELETE /identity/v3/users/12c1c0a85b834811b8124b095aa00399 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:22.789405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:22.789916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:22.790012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:22.807559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:22.808792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:22.887637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1131/2268] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:22.894589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:22.896019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:22.959890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba7cb-d51e-4081-8122-b837e2f77724 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:22.964626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd88e2a-fbaa-4b99-9c19-3f3aaf6c3f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:22.965251 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd88e2a-fbaa-4b99-9c19-3f3aaf6c3f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:22.965541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd88e2a-fbaa-4b99-9c19-3f3aaf6c3f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:22.965822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd88e2a-fbaa-4b99-9c19-3f3aaf6c3f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:22.979253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd88e2a-fbaa-4b99-9c19-3f3aaf6c3f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:22.981154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd88e2a-fbaa-4b99-9c19-3f3aaf6c3f48 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:22.991618 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1138/2269] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:23.312736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:23.314425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:23.332667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733f2e9-d7da-4226-9196-45f67dfeb02d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:23.337983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:23.339343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.339496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.339823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] PATH_INFO: `/v3/projects/1fe2d430c9d94824b3dd5162bce18517` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.341119 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe2d430c9d94824b3dd5162bce18517)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:23.343073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:23.400839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe2d430c9d94824b3dd5162bce18517', 'request_id': 'req-88e871e0-4092-48cc-8da1-b126aaa37fba'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:23.410543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe2d430c9d94824b3dd5162bce18517', 'request_id': 'req-88e871e0-4092-48cc-8da1-b126aaa37fba'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:23.417397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe2d430c9d94824b3dd5162bce18517', 'request_id': 'req-88e871e0-4092-48cc-8da1-b126aaa37fba'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:23.430188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] The token cache is being invalidate because project 1fe2d430c9d94824b3dd5162bce18517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:14:23.430542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:23.431224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-88e871e0-4092-48cc-8da1-b126aaa37fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:23.433175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1132/2270] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:14:23 2022] DELETE /identity/v3/projects/1fe2d430c9d94824b3dd5162bce18517 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:23.438706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.439036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.439351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.465454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:23.467069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:23.498015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:23.548954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1139/2271] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:23.558408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.559180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.559461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.597515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:23.599081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:23.622248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1133/2272] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:23.626599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:23.638955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bcb2b-30dc-4a2f-bd58-22cbff38df26 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:23.644987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:23.646582 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.647224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.647840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.648979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:14:23.649611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:23.652040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:23.667416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1140/2273] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:14:23.671943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:23.684607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e264-4a47-43df-906f-28779b7266ec None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:23.693823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:23.694506 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.694788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.695059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.695793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:23.700533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:23.741449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1134/2274] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:14:23 2022] POST /identity/v3/projects => generated 399 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:23.743046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:23.756259 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e62b7f-cc0d-44d6-b98b-6e8c8427aee1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:23.858037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:23.858738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.859014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.859292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.859995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:23.861990 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:23.912918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1141/2275] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:14:23 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:23.914485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:23.932282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d8f72-8e44-408b-8f8f-59b154aadb14 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:23.943058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:23.943753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.944035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.944311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.945089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:23.946870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:23.970885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1135/2276] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:23.971694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:23.985078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263933-4368-4530-b311-cd0a2e9fb299 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:23.990299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fa99e-f433-494f-be8e-b67d8dd12bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:23.991064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fa99e-f433-494f-be8e-b67d8dd12bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:23.991348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fa99e-f433-494f-be8e-b67d8dd12bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:23.991667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fa99e-f433-494f-be8e-b67d8dd12bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:23.992738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fa99e-f433-494f-be8e-b67d8dd12bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:23.996059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fa99e-f433-494f-be8e-b67d8dd12bd8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:24.013649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1142/2277] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:14:24.017400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:24.031888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cefe74-fd11-4ffb-98ba-ccaf5e45edfd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:24.036685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:24.037859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:24.038366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:24.038655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] PATH_INFO: `/v3/projects/e1ea7d4be559476fae834eb1634ce11c/users/ad1b97f0d1f24db4ab563d2e4eca925d/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:24.065786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ea7d4be559476fae834eb1634ce11c, user_id=ad1b97f0d1f24db4ab563d2e4eca925d, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:24.068781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:24.085674 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1136/2278] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:24 2022] PUT /identity/v3/projects/e1ea7d4be559476fae834eb1634ce11c/users/ad1b97f0d1f24db4ab563d2e4eca925d/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:24.097645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:24.097994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:24.098271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:24.145511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] MFA Rules not processed for user `ad1b97f0d1f24db4ab563d2e4eca925d`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:24.147050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:24.222111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1143/2279] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:24.233605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:24.235301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:24.259386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:24.308602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ccc0-2a6c-4ab8-bc17-d0c6b4ffb3b8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:24.312485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add91bdd-985a-4939-b571-540c991d2275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:24.313211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91bdd-985a-4939-b571-540c991d2275 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:24.313493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91bdd-985a-4939-b571-540c991d2275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:24.313746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91bdd-985a-4939-b571-540c991d2275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:24.324748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91bdd-985a-4939-b571-540c991d2275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:24.326338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91bdd-985a-4939-b571-540c991d2275 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:24.347586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1137/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:33.793901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:33.875470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:33.955784 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6bcb-9ce1-4231-a4d4-ad4061e25649 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:33.961898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:33.963204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:33.963801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:33.964232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] PATH_INFO: `/v3/users/ad1b97f0d1f24db4ab563d2e4eca925d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:33.965863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1b97f0d1f24db4ab563d2e4eca925d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:33.968972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:34.061249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1b97f0d1f24db4ab563d2e4eca925d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:34.062661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1b97f0d1f24db4ab563d2e4eca925d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:34.063637 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1b97f0d1f24db4ab563d2e4eca925d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:34.075499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1b97f0d1f24db4ab563d2e4eca925d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:34.102866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1b97f0d1f24db4ab563d2e4eca925d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:34.130113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1144/2281] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:14:33 2022] DELETE /identity/v3/users/ad1b97f0d1f24db4ab563d2e4eca925d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:34.134404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:34.135292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:34.136584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:34.170450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:34.172665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:34.272318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1138/2282] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:34.283849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:34.285124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:34.371767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcabbc-8917-400f-ae81-4ce7764509c1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:34.379683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6926426-a373-413e-8361-b57397157b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:34.381871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926426-a373-413e-8361-b57397157b5b service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:34.382427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926426-a373-413e-8361-b57397157b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:34.382955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926426-a373-413e-8361-b57397157b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:34.396294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6926426-a373-413e-8361-b57397157b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:34.398305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6926426-a373-413e-8361-b57397157b5b service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:34.416958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1145/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:35.079357 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:35.083274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:35.109459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb347ae-27f2-4b18-bb90-17a6173025eb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:35.120339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:35.122379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:35.122892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:35.123310 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] PATH_INFO: `/v3/projects/e1ea7d4be559476fae834eb1634ce11c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:35.125482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ea7d4be559476fae834eb1634ce11c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:35.130857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:35.232115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ea7d4be559476fae834eb1634ce11c', 'request_id': 'req-a6ba8423-1bd2-4f0b-bc25-84b313719227'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:35.262396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ea7d4be559476fae834eb1634ce11c', 'request_id': 'req-a6ba8423-1bd2-4f0b-bc25-84b313719227'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:35.284146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ea7d4be559476fae834eb1634ce11c', 'request_id': 'req-a6ba8423-1bd2-4f0b-bc25-84b313719227'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:35.306792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] The token cache is being invalidate because project e1ea7d4be559476fae834eb1634ce11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:14:35.307432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:35.308603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:35.311433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1139/2284] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:14:35 2022] DELETE /identity/v3/projects/e1ea7d4be559476fae834eb1634ce11c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:38.881521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:38.882033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:38.882127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:38.900217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:38.901492 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:38.936671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:38.966617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1146/2285] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jun 7 13:14:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:38.979219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:38.980729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:39.036956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:39.059984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba8423-1bd2-4f0b-bc25-84b313719227 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:39.065476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:39.066127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:39.066404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:39.066675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:39.074638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:39.076218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:39.084102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1140/2286] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:14:45.411779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:45.413455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:45.486731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f6a81-c84a-4dfb-9055-fc64d6a3d654 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:45.491534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:45.492410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:45.492699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:45.492961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] PATH_INFO: `/v3/users/aaefc46a7e6d431c9eebc5233389c61e` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:45.494225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaefc46a7e6d431c9eebc5233389c61e)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:45.496148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:45.550808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaefc46a7e6d431c9eebc5233389c61e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.551445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaefc46a7e6d431c9eebc5233389c61e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.552068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaefc46a7e6d431c9eebc5233389c61e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.558844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaefc46a7e6d431c9eebc5233389c61e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.572428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72853c6d-0d97-479e-8d91-9f35f6d87cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaefc46a7e6d431c9eebc5233389c61e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.588018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1147/2287] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:14:45 2022] DELETE /identity/v3/users/aaefc46a7e6d431c9eebc5233389c61e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:45.769057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:45.782979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed568-efa9-429f-8d81-295b301ee95f service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:45.842369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:45.843445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:45.843727 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:45.843997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] PATH_INFO: `/v3/projects/56eca409cb874456afc7f0acc51c7e40` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:45.845206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56eca409cb874456afc7f0acc51c7e40)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:45.847103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:45.894370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56eca409cb874456afc7f0acc51c7e40', 'request_id': 'req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.902873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56eca409cb874456afc7f0acc51c7e40', 'request_id': 'req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.908576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56eca409cb874456afc7f0acc51c7e40', 'request_id': 'req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.919967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] The token cache is being invalidate because project 56eca409cb874456afc7f0acc51c7e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:14:45.920271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.921134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-604f6e9a-8523-4cd9-9aee-0e1c95ee6749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:14:45.922806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1141/2288] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:14:45 2022] DELETE /identity/v3/projects/56eca409cb874456afc7f0acc51c7e40 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:45.927739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:45.928109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:45.928416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:45.947950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:45.949210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:46.001753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:46.013737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1148/2289] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:46.021453 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.021739 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.022020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.041379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:46.042584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:46.054560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1142/2290] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:14:46.060133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.072026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b516-7cac-46a6-84ab-57544e274f82 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.077047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.077906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.078193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.078469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.079216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:14:46.079540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.081194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.093357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1149/2291] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:14:46.097933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.107391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364df3b-6d3e-4e7c-a438-60747a2121ff None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.112927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.113614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.113895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.114166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.114867 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.116785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.146817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1143/2292] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:14:46 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:46.147900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.158029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e91b5-d8e8-40e5-86f2-3e58a3b380fe admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.220102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.220801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.221124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.221406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.222114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.224065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.245927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1150/2293] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:14:46 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:14:46.250517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.261788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b320ab-298a-4b1e-9b26-8ba63fef1681 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.267826 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.268491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.268777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.269061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.269824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.271423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.282810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1144/2294] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:46.288997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.305288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0bd27-9ab7-404d-8666-4fa136a97de2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.313800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc2364-46c0-40e6-8978-a2d205fd7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.314460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc2364-46c0-40e6-8978-a2d205fd7be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.314737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc2364-46c0-40e6-8978-a2d205fd7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.315008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc2364-46c0-40e6-8978-a2d205fd7be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.315768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc2364-46c0-40e6-8978-a2d205fd7be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.317654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc2364-46c0-40e6-8978-a2d205fd7be1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.329096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1151/2295] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:14:46.335267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.348925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c63a15-20f7-4e9b-83c9-22205bdbcc73 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.355711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.357106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.357484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.357912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] PATH_INFO: `/v3/projects/0fd7d31ad30b4c17b5a0d93a570f0786/users/e2aeac5b60884be8866e3249b100d9e9/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.379905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd7d31ad30b4c17b5a0d93a570f0786, user_id=e2aeac5b60884be8866e3249b100d9e9, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.382640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.398407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1145/2296] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:14:46 2022] PUT /identity/v3/projects/0fd7d31ad30b4c17b5a0d93a570f0786/users/e2aeac5b60884be8866e3249b100d9e9/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:14:46.409571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.409865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.410182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.439204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] MFA Rules not processed for user `e2aeac5b60884be8866e3249b100d9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:46.440448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:46.510420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1152/2297] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:46.522312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:46.523997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:46.527860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:46.605909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60239a-8b08-46d5-b7e8-80dfd425c8b9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:46.609693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e8ba0-bedd-4b0a-b99c-fd5bd8792add service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:46.610343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8ba0-bedd-4b0a-b99c-fd5bd8792add service glance] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:46.610612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8ba0-bedd-4b0a-b99c-fd5bd8792add service glance] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:46.610992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8ba0-bedd-4b0a-b99c-fd5bd8792add service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:46.620099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e8ba0-bedd-4b0a-b99c-fd5bd8792add service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:46.621589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e8ba0-bedd-4b0a-b99c-fd5bd8792add service glance] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:46.630688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1146/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:50.122932 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:50.128462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:50.226172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:50.275100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3d46-3d31-461f-8bb8-6f9ec2f1805d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:50.280408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:50.281102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:50.281391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:50.281706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:50.283591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:50.295360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:50.296998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:50.307040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1153/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:14:50.765924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:50.766460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:50.766460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:50.790379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] MFA Rules not processed for user `025ca1d10d5e49e984c7fd4e0b425f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:14:50.791823 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:50.851306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1147/2300] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:14:56.380054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:14:56.381801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:56.442058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6751d-5c74-4b47-ac71-656b10d6c859 service placement] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:14:56.445937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:14:56.446589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:14:56.446870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:14:56.447262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:14:56.449138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:14:56.513687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:14:56.515141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe5cb-b5ea-4b0d-8acb-cff688d4c7d7 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:14:56.524965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1154/2301] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:00.843298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=59 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:06.520634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=67 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:07.123676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:07.125200 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:07.191207 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94077dbc-b5d1-4741-8cec-39b0640de459 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:07.196670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:07.197549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:07.197834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:07.198226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] PATH_INFO: `/v3/users/fdbf6d0e683744079c3e9bb116285e10` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:07.199587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbf6d0e683744079c3e9bb116285e10)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:07.201649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:07.251371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbf6d0e683744079c3e9bb116285e10'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.252020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbf6d0e683744079c3e9bb116285e10'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.252657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbf6d0e683744079c3e9bb116285e10'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.259968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbf6d0e683744079c3e9bb116285e10'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.271311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbf6d0e683744079c3e9bb116285e10'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.286380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1148/2302] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:07 2022] DELETE /identity/v3/users/fdbf6d0e683744079c3e9bb116285e10 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:07.291078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:07.291376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:07.291659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:07.311869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:07.313116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:07.375282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1155/2303] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:07.389266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:07.391655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:07.460484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297123b-f39f-4895-89c4-699031e87090 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:07.464334 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:07.464992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:07.465306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:07.465580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:07.476406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:07.478131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:07.490658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1149/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:07.773520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:07.775146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:07.787160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fedf2e-7282-4f87-935c-8d9bd500cb19 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:07.792210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:07.793239 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:07.793518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:07.793803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] PATH_INFO: `/v3/projects/28436684af7740ac953833c30a42f259` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:07.795087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28436684af7740ac953833c30a42f259)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:07.798167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:07.847023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28436684af7740ac953833c30a42f259', 'request_id': 'req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.855306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28436684af7740ac953833c30a42f259', 'request_id': 'req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.861319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28436684af7740ac953833c30a42f259', 'request_id': 'req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.872531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] The token cache is being invalidate because project 28436684af7740ac953833c30a42f259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:07.872814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.873895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:07.875513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1156/2305] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:07 2022] DELETE /identity/v3/projects/28436684af7740ac953833c30a42f259 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:07.880580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:07.894656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05230-5ec6-4386-9f15-584600d30e1c service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:07.913860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:07.955815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:07.956722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:07.957067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:07.957278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] PATH_INFO: `/v3/users/e826adf8cc5942f0a3e0347ba2f6a97f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:07.958505 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e826adf8cc5942f0a3e0347ba2f6a97f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:07.960448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.012792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e826adf8cc5942f0a3e0347ba2f6a97f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.013496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e826adf8cc5942f0a3e0347ba2f6a97f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.014090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e826adf8cc5942f0a3e0347ba2f6a97f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.021742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e826adf8cc5942f0a3e0347ba2f6a97f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.038368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2cc2925c-af31-4c70-8e6f-1f33fe481d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e826adf8cc5942f0a3e0347ba2f6a97f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.056076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1150/2306] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:07 2022] DELETE /identity/v3/users/e826adf8cc5942f0a3e0347ba2f6a97f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:08.351220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.352721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:08.368774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d1a16-ed9c-4c4b-997f-3e0049618f3a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.441319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.442496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.442864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.443238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] PATH_INFO: `/v3/projects/2a4a89064e4045bea380344aa2e049cb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.444860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4a89064e4045bea380344aa2e049cb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.447615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.484075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:08.503129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4a89064e4045bea380344aa2e049cb', 'request_id': 'req-844cc7b1-2a81-4f7b-a372-734bffb6267b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.512625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4a89064e4045bea380344aa2e049cb', 'request_id': 'req-844cc7b1-2a81-4f7b-a372-734bffb6267b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.519395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4a89064e4045bea380344aa2e049cb', 'request_id': 'req-844cc7b1-2a81-4f7b-a372-734bffb6267b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.531543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] The token cache is being invalidate because project 2a4a89064e4045bea380344aa2e049cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:08.531835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.532549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-844cc7b1-2a81-4f7b-a372-734bffb6267b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:08.534524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1157/2307] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:08 2022] DELETE /identity/v3/projects/2a4a89064e4045bea380344aa2e049cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:08.539695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.540217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.540217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.560450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:08.561711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:08.627057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1151/2308] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:08.635889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.636176 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.636460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.655241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:08.656457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:08.665277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1158/2309] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:15:08.671776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.683701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2ee9-4c2e-4d1a-92f2-75a476d2b703 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.691860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.692524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.692803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.693102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.693844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:08.694149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.695745 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.709268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1152/2310] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:08.715277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.725414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d2b0d-498c-4a04-8c37-c2397b2a3360 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.732734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.733826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.734201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.734565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.735648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.739195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.772548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1159/2311] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:08 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:08.777912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.789835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc80273-d757-4e9e-9f1f-5fa8ea3c1e58 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.819073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:08.854148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.854846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.855124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.855424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.856114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.858159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.879773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1153/2312] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:08 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:08.883920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.895298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4efdc3-3e9c-4d84-b86f-be9e3e6e0ac7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.900250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.900926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.901243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.901524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.902263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.903880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.915183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1160/2313] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:08.919407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.929583 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fd0e-e4f3-4c28-bca6-34cd34afd5a3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.934304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968d1c9-627d-4cd2-aa27-8fecffc77e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.934976 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968d1c9-627d-4cd2-aa27-8fecffc77e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.935260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968d1c9-627d-4cd2-aa27-8fecffc77e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.935532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968d1c9-627d-4cd2-aa27-8fecffc77e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.936278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968d1c9-627d-4cd2-aa27-8fecffc77e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.937909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968d1c9-627d-4cd2-aa27-8fecffc77e23 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:08.948161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1154/2314] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:08.952596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:08.965003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55259d-47a5-4010-899e-e0a1b5badf9c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:08.971161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:08.972329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:08.972720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:08.972908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] PATH_INFO: `/v3/projects/177110082d854edd9013ddc8e93bb9e7/users/3593be930d39494c80ff0557e3138da5/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:08.993887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=177110082d854edd9013ddc8e93bb9e7, user_id=3593be930d39494c80ff0557e3138da5, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:08.996651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.012328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1161/2315] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:08 2022] PUT /identity/v3/projects/177110082d854edd9013ddc8e93bb9e7/users/3593be930d39494c80ff0557e3138da5/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:09.023294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.023846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.024126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.051807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] MFA Rules not processed for user `3593be930d39494c80ff0557e3138da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:09.053272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:09.126090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1155/2316] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:15:09.131869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.195495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404025-8192-48fe-a5a1-e040769f9eea admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.200386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.201080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.201434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.201720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.202414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.204346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.232519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1162/2317] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:09 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:09.236574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.248485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38ecdc-a036-4357-81ee-2e96999894d1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.320016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.320711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.320987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.321288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.321993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.323926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.348852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1156/2318] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:09 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:09.350416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.360767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb3dc-7f1c-4fe3-958c-92ac2e0a6587 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.365473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.366141 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.366422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.366694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.367427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.369079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.380457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1163/2319] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:09.384819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.395125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc086-ef65-4836-b8c8-e18f51bcae83 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.399834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.400832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.401229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.401543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] PATH_INFO: `/v3/projects/4bac63d1084e4cc79c5240d2a0f3a2db/users/cdbde072f59646bdab5089790788cddf/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.417794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bac63d1084e4cc79c5240d2a0f3a2db, user_id=cdbde072f59646bdab5089790788cddf, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.420443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.436489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1157/2320] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:09 2022] PUT /identity/v3/projects/4bac63d1084e4cc79c5240d2a0f3a2db/users/cdbde072f59646bdab5089790788cddf/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:09.440589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.451493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf25b-eab7-40a8-8e5a-afd92e81a829 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.471608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:09.516810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49622-b05f-466c-b6af-5ddb520b5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.517542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49622-b05f-466c-b6af-5ddb520b5ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.517816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49622-b05f-466c-b6af-5ddb520b5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.518117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49622-b05f-466c-b6af-5ddb520b5ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.519116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b49622-b05f-466c-b6af-5ddb520b5ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.520745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b49622-b05f-466c-b6af-5ddb520b5ae6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.535155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1164/2321] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:09.539686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.547713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:09.555008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e1cdc-4c34-4d5b-9cbd-19a93daa8fee admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.566802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.567755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.568038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.568271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] PATH_INFO: `/v3/projects/4bac63d1084e4cc79c5240d2a0f3a2db/users/cdbde072f59646bdab5089790788cddf/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.570325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bac63d1084e4cc79c5240d2a0f3a2db, user_id=cdbde072f59646bdab5089790788cddf, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.572977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.584525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1158/2322] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:09 2022] PUT /identity/v3/projects/4bac63d1084e4cc79c5240d2a0f3a2db/users/cdbde072f59646bdab5089790788cddf/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:09.599946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.600243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.600521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.630285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] MFA Rules not processed for user `cdbde072f59646bdab5089790788cddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:09.631503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:09.701774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1165/2323] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:09.714195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:09.716075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:09.812578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799b05d-7932-4cfa-a100-faed14761ef4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:09.817173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:09.817810 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:09.818087 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:09.818361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:09.827479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:09.828891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:09.838589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1159/2324] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:10.178206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:10.187749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17904c-38e0-41d0-b155-82868908a76c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:10.193340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdbde072f59646bdab5089790788cddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bac63d1084e4cc79c5240d2a0f3a2db', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:10.194007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:10.194300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:10.194565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:10.195303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:10.195615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:10.197256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:10.209468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1166/2325] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:10.213685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:10.222951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e27d0-aa82-4012-a4ec-df23740f67c9 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:10.228050 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdbde072f59646bdab5089790788cddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bac63d1084e4cc79c5240d2a0f3a2db', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:10.228707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:10.228995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:10.229292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:10.229989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:10.231880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:10.260992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1160/2326] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:10 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:10.265174 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:10.275247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc4510-111d-4298-b902-e529f9119f06 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:10.337339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdbde072f59646bdab5089790788cddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bac63d1084e4cc79c5240d2a0f3a2db', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:10.338351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:10.338770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:10.339116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:10.340234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:10.340538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:10.342972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:10.356746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1167/2327] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:10.395195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:10.406541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcad65-e2ff-42f9-9c80-8369fdf86274 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:10.412169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdbde072f59646bdab5089790788cddf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bac63d1084e4cc79c5240d2a0f3a2db', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:10.413378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:10.413659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:10.413931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] PATH_INFO: `/v3/projects/455090f93bf14dbfb9fbf87f0371f9f1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:10.415210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorizing `identity:delete_project(project_id=455090f93bf14dbfb9fbf87f0371f9f1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:10.417156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:10.473463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455090f93bf14dbfb9fbf87f0371f9f1', 'request_id': 'req-5b01ef2b-995a-4e51-826b-0e39b1346ea3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.483465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455090f93bf14dbfb9fbf87f0371f9f1', 'request_id': 'req-5b01ef2b-995a-4e51-826b-0e39b1346ea3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.490235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455090f93bf14dbfb9fbf87f0371f9f1', 'request_id': 'req-5b01ef2b-995a-4e51-826b-0e39b1346ea3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.504468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] The token cache is being invalidate because project 455090f93bf14dbfb9fbf87f0371f9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:10.505029 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.505843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5b01ef2b-995a-4e51-826b-0e39b1346ea3 tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.508117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1161/2328] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:10 2022] DELETE /identity/v3/projects/455090f93bf14dbfb9fbf87f0371f9f1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:10.725408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:10.727374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:10.760450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:10.796682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b329c35-3a10-4ed0-b478-a497ec1249ba tempest-VolumeQuotaClassesTest-1975395687 tempest-VolumeQuotaClassesTest-1975395687-project-admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:10.861158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:10.862360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:10.862678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:10.862955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] PATH_INFO: `/v3/users/3593be930d39494c80ff0557e3138da5` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:10.864214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3593be930d39494c80ff0557e3138da5)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:10.866250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:10.919423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3593be930d39494c80ff0557e3138da5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.920080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3593be930d39494c80ff0557e3138da5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.920712 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3593be930d39494c80ff0557e3138da5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.928574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3593be930d39494c80ff0557e3138da5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.941689 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3593be930d39494c80ff0557e3138da5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:10.956642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1168/2329] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:10 2022] DELETE /identity/v3/users/3593be930d39494c80ff0557e3138da5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:10.961360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:10.961863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:10.961960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:10.979566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:10.980694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:11.012830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:11.045532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1162/2330] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:11.055374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:11.056973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:11.118544 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cce55-2e0c-4b76-9545-ac6403c9a9cc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:11.122923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:11.123929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:11.124215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:11.124486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:11.132177 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:11.134575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:11.136048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:11.146169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1169/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:11.430122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:11.431905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:11.444347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c04f-7c1b-4dfc-99c5-6b372b7bd8fc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:11.455975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:11.457043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:11.457370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:11.457835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] PATH_INFO: `/v3/projects/177110082d854edd9013ddc8e93bb9e7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:11.460623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177110082d854edd9013ddc8e93bb9e7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:11.462650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:11.513922 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177110082d854edd9013ddc8e93bb9e7', 'request_id': 'req-b2f65301-38f4-4b29-a55d-27dc88738c92'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.522380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177110082d854edd9013ddc8e93bb9e7', 'request_id': 'req-b2f65301-38f4-4b29-a55d-27dc88738c92'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.528993 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177110082d854edd9013ddc8e93bb9e7', 'request_id': 'req-b2f65301-38f4-4b29-a55d-27dc88738c92'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.541476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] The token cache is being invalidate because project 177110082d854edd9013ddc8e93bb9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:11.541759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.542777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.543982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1163/2332] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:11 2022] DELETE /identity/v3/projects/177110082d854edd9013ddc8e93bb9e7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:11.547951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:11.558270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391e59-9007-4ee0-8e1f-922320747f76 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:11.621052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:11.621963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:11.622246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:11.622521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] PATH_INFO: `/v3/users/cdbde072f59646bdab5089790788cddf` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:11.624093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdbde072f59646bdab5089790788cddf)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:11.626087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:11.674575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdbde072f59646bdab5089790788cddf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.675318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdbde072f59646bdab5089790788cddf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.675927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdbde072f59646bdab5089790788cddf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.682605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdbde072f59646bdab5089790788cddf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.694476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2933ba7c-1c87-431b-a52d-e1244b4c774a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdbde072f59646bdab5089790788cddf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:11.710012 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1170/2333] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:11 2022] DELETE /identity/v3/users/cdbde072f59646bdab5089790788cddf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:12.006304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.008953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:12.034542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65301-38f4-4b29-a55d-27dc88738c92 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.109959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.110880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.111156 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.111420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] PATH_INFO: `/v3/projects/4bac63d1084e4cc79c5240d2a0f3a2db` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.112746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bac63d1084e4cc79c5240d2a0f3a2db)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.114687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.165799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bac63d1084e4cc79c5240d2a0f3a2db', 'request_id': 'req-936e695a-79aa-485d-bf1f-9d331355f1ce'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:12.175424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bac63d1084e4cc79c5240d2a0f3a2db', 'request_id': 'req-936e695a-79aa-485d-bf1f-9d331355f1ce'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:12.179018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:12.184187 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bac63d1084e4cc79c5240d2a0f3a2db', 'request_id': 'req-936e695a-79aa-485d-bf1f-9d331355f1ce'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:12.199839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] The token cache is being invalidate because project 4bac63d1084e4cc79c5240d2a0f3a2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:12.200176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:12.201072 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-936e695a-79aa-485d-bf1f-9d331355f1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:12.203430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1164/2334] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:12 2022] DELETE /identity/v3/projects/4bac63d1084e4cc79c5240d2a0f3a2db => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:12.208762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.209074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.209518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.231491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:12.232826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:12.297496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1171/2335] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:12.305383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.305688 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.305979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.324528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:12.325774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:12.334880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1165/2336] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:12.338452 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.348456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea38cd-c8b1-471d-8ed6-28e8304f871a None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.353029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.353705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.353989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.354262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.355311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:12.355311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.356906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.369432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1172/2337] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:12.374145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.383554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ce0c4-d0eb-4a7c-88b2-ea059ee941b6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.388283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.388921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.389233 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.389504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.390205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.392102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.420618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1166/2338] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:12 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:15:12.424849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.431356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:12.435402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccb43d-93eb-403b-89a0-0ef6c2834df9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.505906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.506656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.506937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.507212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.508103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.510133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.531196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1173/2339] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:12 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:12.535660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.546660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeaf92-116f-4d1d-b892-f85f23f4b813 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.555394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.555994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.556281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.556550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.557360 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.559075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.571459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1167/2340] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:12.575681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.586423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16552e8f-4c4c-48f0-aed6-d1aa7daf86d8 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.591123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b4c1e-cf19-4ea2-86bf-4af8270e5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.591794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4c1e-cf19-4ea2-86bf-4af8270e5ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.592074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4c1e-cf19-4ea2-86bf-4af8270e5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.592342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4c1e-cf19-4ea2-86bf-4af8270e5ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.593099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b4c1e-cf19-4ea2-86bf-4af8270e5ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.594716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b4c1e-cf19-4ea2-86bf-4af8270e5ac9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.607410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1174/2341] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:12.611891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.621819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4542c-048d-4acd-9862-47469d733320 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.626682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.627563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.627958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.628293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] PATH_INFO: `/v3/projects/ddfa4e689d824b5484c8de2e77470756/users/7f3bab3b8f2342f69607a622e75b49b2/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.643689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfa4e689d824b5484c8de2e77470756, user_id=7f3bab3b8f2342f69607a622e75b49b2, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.646559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.662731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1168/2342] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:12 2022] PUT /identity/v3/projects/ddfa4e689d824b5484c8de2e77470756/users/7f3bab3b8f2342f69607a622e75b49b2/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:15:12.674361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.674811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.675095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.702499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] MFA Rules not processed for user `7f3bab3b8f2342f69607a622e75b49b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:12.703736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:12.767995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1175/2343] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:12.779631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:12.781444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:12.840324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbaa08-8ba2-43df-b01a-de0d47264dbc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:12.843940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf090bc-71b8-4ff5-9e4a-d776be9846e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:12.844609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf090bc-71b8-4ff5-9e4a-d776be9846e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:12.844888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf090bc-71b8-4ff5-9e4a-d776be9846e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:12.845204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf090bc-71b8-4ff5-9e4a-d776be9846e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:12.854410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf090bc-71b8-4ff5-9e4a-d776be9846e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:12.855858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf090bc-71b8-4ff5-9e4a-d776be9846e6 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:12.866108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1169/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:22.764804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:22.861247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=58,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:29.681224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:29.743917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429be181-2a83-44ce-b2ce-ea7eddc62ab7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:29.749327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:29.750361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:29.750609 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:29.750899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] PATH_INFO: `/v3/users/7f3bab3b8f2342f69607a622e75b49b2` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:29.752126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3bab3b8f2342f69607a622e75b49b2)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:29.754127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:29.807707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3bab3b8f2342f69607a622e75b49b2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:29.808450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3bab3b8f2342f69607a622e75b49b2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:29.809296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3bab3b8f2342f69607a622e75b49b2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:29.816507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3bab3b8f2342f69607a622e75b49b2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:29.828998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3bab3b8f2342f69607a622e75b49b2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:29.844480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1176/2345] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:29 2022] DELETE /identity/v3/users/7f3bab3b8f2342f69607a622e75b49b2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:29.849096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:29.849626 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:29.849741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:29.867843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:29.869106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:29.933104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1170/2346] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:29.942812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:29.944223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:30.008398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64931c-36de-4d98-9f74-c0ac1c12ddfc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.012606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7203a-e1ba-4651-9efc-67bf9c48fcd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.013325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7203a-e1ba-4651-9efc-67bf9c48fcd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.013520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7203a-e1ba-4651-9efc-67bf9c48fcd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.013797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7203a-e1ba-4651-9efc-67bf9c48fcd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.023468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7203a-e1ba-4651-9efc-67bf9c48fcd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.025391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7203a-e1ba-4651-9efc-67bf9c48fcd4 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.036065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1177/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:30.317728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.319373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:30.332934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d859438-2d10-4abf-9c39-0d210664f984 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.338352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.339284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.339564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.339839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] PATH_INFO: `/v3/projects/ddfa4e689d824b5484c8de2e77470756` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.341155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfa4e689d824b5484c8de2e77470756)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.343132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.401582 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfa4e689d824b5484c8de2e77470756', 'request_id': 'req-63117b18-7911-4d47-a4d4-835239082483'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:30.410704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfa4e689d824b5484c8de2e77470756', 'request_id': 'req-63117b18-7911-4d47-a4d4-835239082483'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:30.417276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfa4e689d824b5484c8de2e77470756', 'request_id': 'req-63117b18-7911-4d47-a4d4-835239082483'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:30.429284 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] The token cache is being invalidate because project ddfa4e689d824b5484c8de2e77470756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:30.429835 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:30.431239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-63117b18-7911-4d47-a4d4-835239082483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:30.432886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1171/2348] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:30 2022] DELETE /identity/v3/projects/ddfa4e689d824b5484c8de2e77470756 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:30.438089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.438377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.438654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.457163 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:30.458349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:30.476797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:30.524044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1178/2349] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:30.532125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.532395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.532705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.552557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:30.553783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:30.563764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1172/2350] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:30.568677 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.584964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc28d6-616f-4fcd-beae-53e0dab508eb None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.591240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.591913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.592193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.592463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.593253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:30.593559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.595185 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.608853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1179/2351] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:30.613428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.623778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcdeb4-01be-4c4b-a895-987e62a95415 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.629738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.630417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.630698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.630968 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.631666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.633716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.662440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1173/2352] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:30 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:30.667052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.677411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7899-3015-4d5f-9814-e92373c04f21 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.748307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.748981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.749410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.749675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.750371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.752309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.775541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1180/2353] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:30 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:15:30.779851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.790821 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c2862-c528-4335-a716-62dc181815a0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.796779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.797488 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.797765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.798034 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.798767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.800390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.812098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1174/2354] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:30.818337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.829256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460080-51d9-4643-b25d-112f04db62f9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.838548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225848-2f05-40ab-a432-2dbc444ed144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.839218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225848-2f05-40ab-a432-2dbc444ed144 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.839504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225848-2f05-40ab-a432-2dbc444ed144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.839780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225848-2f05-40ab-a432-2dbc444ed144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.840517 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a225848-2f05-40ab-a432-2dbc444ed144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.842172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a225848-2f05-40ab-a432-2dbc444ed144 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.852429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1181/2355] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:30.856839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:30.867378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12b207-6c8a-4b0b-8b6d-6cbbb67e3c86 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:30.871937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:30.873220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.873495 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.873766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] PATH_INFO: `/v3/projects/e4e1bc5ce2fa4fa2a0155a0f94d7d343/users/16dac3991e534b22b93d55aeef1583b8/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.889785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e1bc5ce2fa4fa2a0155a0f94d7d343, user_id=16dac3991e534b22b93d55aeef1583b8, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:30.892419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:30.907032 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1175/2356] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:30 2022] PUT /identity/v3/projects/e4e1bc5ce2fa4fa2a0155a0f94d7d343/users/16dac3991e534b22b93d55aeef1583b8/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:30.919270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:30.919437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:30.919728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:30.948223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] MFA Rules not processed for user `16dac3991e534b22b93d55aeef1583b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:30.949483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:31.020276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1182/2357] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:31.031499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:31.033339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:31.060784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:31.093715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd455e-fccd-4876-9a28-7eea4092e114 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:31.097445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7783dc4-427a-461c-8c6c-da6bb1b28cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:31.098097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7783dc4-427a-461c-8c6c-da6bb1b28cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:31.098375 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7783dc4-427a-461c-8c6c-da6bb1b28cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:31.098649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7783dc4-427a-461c-8c6c-da6bb1b28cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:31.107312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7783dc4-427a-461c-8c6c-da6bb1b28cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:31.108767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7783dc4-427a-461c-8c6c-da6bb1b28cd5 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:31.118129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1176/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:31.144085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:31.164117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:31.209489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0571b2-d300-4136-b109-bc79be6cfc8f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:31.215307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:31.216190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:31.216470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:31.216747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] PATH_INFO: `/v3/users/16dac3991e534b22b93d55aeef1583b8` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:31.217968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dac3991e534b22b93d55aeef1583b8)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:31.219893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:31.268506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dac3991e534b22b93d55aeef1583b8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.269410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dac3991e534b22b93d55aeef1583b8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.270198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dac3991e534b22b93d55aeef1583b8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.280016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dac3991e534b22b93d55aeef1583b8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.292019 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dac3991e534b22b93d55aeef1583b8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.306258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1183/2359] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:31 2022] DELETE /identity/v3/users/16dac3991e534b22b93d55aeef1583b8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:31.313252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:31.313252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:31.313252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:31.332474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:31.333751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:31.402948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1177/2360] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:31.412925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:31.414835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:31.477764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5363f4-dfac-4516-92bd-a587bd84e7d9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:31.481933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:31.482600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:31.482900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:31.483172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:31.492947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:31.494401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:31.504305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1184/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:31.774560 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:31.776105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:31.788290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3732a-1ab1-493d-b376-4f1669fd80ad None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:31.793836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:31.794718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:31.794999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:31.795316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] PATH_INFO: `/v3/projects/e4e1bc5ce2fa4fa2a0155a0f94d7d343` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:31.797538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e1bc5ce2fa4fa2a0155a0f94d7d343)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:31.799426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:31.849953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e1bc5ce2fa4fa2a0155a0f94d7d343', 'request_id': 'req-f4fdea12-356e-4c91-abf3-eab7c8168d51'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.859331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e1bc5ce2fa4fa2a0155a0f94d7d343', 'request_id': 'req-f4fdea12-356e-4c91-abf3-eab7c8168d51'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.865173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e1bc5ce2fa4fa2a0155a0f94d7d343', 'request_id': 'req-f4fdea12-356e-4c91-abf3-eab7c8168d51'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.876871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] The token cache is being invalidate because project e4e1bc5ce2fa4fa2a0155a0f94d7d343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:31.877193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.877830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f4fdea12-356e-4c91-abf3-eab7c8168d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:31.879398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1178/2362] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:31 2022] DELETE /identity/v3/projects/e4e1bc5ce2fa4fa2a0155a0f94d7d343 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:15:41.499985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:41.874134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:42.325539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:42.327200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:42.341244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644dd49-1b58-4c00-90c3-b5b2e76ef32d service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:42.405730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:42.406723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:42.407026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:42.407273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] PATH_INFO: `/v3/users/e2aeac5b60884be8866e3249b100d9e9` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:42.408527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2aeac5b60884be8866e3249b100d9e9)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:42.410479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:42.461189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2aeac5b60884be8866e3249b100d9e9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:42.461824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2aeac5b60884be8866e3249b100d9e9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:42.462423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2aeac5b60884be8866e3249b100d9e9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:42.470923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2aeac5b60884be8866e3249b100d9e9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:42.484708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2aeac5b60884be8866e3249b100d9e9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:42.500796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1185/2363] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:42 2022] DELETE /identity/v3/users/e2aeac5b60884be8866e3249b100d9e9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:42.505531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:42.505850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:42.506132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:42.526241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:42.527477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:42.596580 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1179/2364] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:42.606545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:42.608187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:42.666890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54ff84-40af-4f99-92a1-5941aeb48264 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:42.670918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ca26d-386e-42b2-9bb0-14a29311afc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:42.671568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca26d-386e-42b2-9bb0-14a29311afc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:42.671855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca26d-386e-42b2-9bb0-14a29311afc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:42.672248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca26d-386e-42b2-9bb0-14a29311afc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:42.682608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ca26d-386e-42b2-9bb0-14a29311afc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:42.684148 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ca26d-386e-42b2-9bb0-14a29311afc1 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:42.694640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1186/2365] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:42.984918 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:42.986403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:43.003779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af81d69-7e72-45f2-bae1-344132d10562 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.010574 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.011463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.011797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.011972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] PATH_INFO: `/v3/projects/0fd7d31ad30b4c17b5a0d93a570f0786` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.013313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd7d31ad30b4c17b5a0d93a570f0786)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.015238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.062841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd7d31ad30b4c17b5a0d93a570f0786', 'request_id': 'req-633cb102-7ab5-48b5-ad9d-afcd841e508a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:43.072797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd7d31ad30b4c17b5a0d93a570f0786', 'request_id': 'req-633cb102-7ab5-48b5-ad9d-afcd841e508a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:43.078308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd7d31ad30b4c17b5a0d93a570f0786', 'request_id': 'req-633cb102-7ab5-48b5-ad9d-afcd841e508a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:43.089045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] The token cache is being invalidate because project 0fd7d31ad30b4c17b5a0d93a570f0786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:43.089352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:43.089960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-633cb102-7ab5-48b5-ad9d-afcd841e508a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:43.091499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1180/2366] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:42 2022] DELETE /identity/v3/projects/0fd7d31ad30b4c17b5a0d93a570f0786 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:43.096699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.096996 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.097307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.115435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:43.116646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:43.135252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:43.183897 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1187/2367] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:15:43.193246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.193566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.193951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.222800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:43.224002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:43.233685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1181/2368] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:43.238375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.249124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fb56e-c8e0-46e9-8d34-81cadc14fbf3 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.254841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.255503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.255792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.256066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.256820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:43.257152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.258755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.271665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1188/2369] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:43.276053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.285761 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa6514-ae8f-4388-acc4-99c577132d3a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.291533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.292179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.292463 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.292737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.293484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.295381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.325114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1182/2370] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:43 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:15:43.329480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.340197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f2290-2202-4d52-ad67-50f68d876057 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.398769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.399382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.399666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.399942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.400649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.402684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.425716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1189/2371] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:43 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:15:43.429980 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.440424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af789f9-5db6-4eb4-8090-e3a7fd1d0390 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.445401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.446058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.446336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.446608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.447344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.448934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.459422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1183/2372] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:43.463407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.474045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d3b5-d378-4f41-96cd-6b71f991b77c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.479803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8293ee7-4971-40d9-b88c-0f110f0eaae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.480636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8293ee7-4971-40d9-b88c-0f110f0eaae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.480926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8293ee7-4971-40d9-b88c-0f110f0eaae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.481237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8293ee7-4971-40d9-b88c-0f110f0eaae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.482005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8293ee7-4971-40d9-b88c-0f110f0eaae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.483663 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8293ee7-4971-40d9-b88c-0f110f0eaae6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.494421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1190/2373] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:43.499467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.510116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21b973-5dd7-4ff3-a616-5d1c9389f6ba admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.515141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.516047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.516327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.516603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] PATH_INFO: `/v3/projects/dfef0c39f9fd4b759f5222b3cbdeeaff/users/fcb87db799d64a94945f85992f3ca01e/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.531660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfef0c39f9fd4b759f5222b3cbdeeaff, user_id=fcb87db799d64a94945f85992f3ca01e, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.534351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.549616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1184/2374] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:43 2022] PUT /identity/v3/projects/dfef0c39f9fd4b759f5222b3cbdeeaff/users/fcb87db799d64a94945f85992f3ca01e/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:15:43.560666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.561201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.561201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.589489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] MFA Rules not processed for user `fcb87db799d64a94945f85992f3ca01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:43.590709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:43.664123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1191/2375] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:43.675130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:43.677175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:43.700273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:43.736424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38ddcd-6c83-4376-928c-484b89dd1e49 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:43.740397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020127-915c-45e6-9736-e4d36e1ec4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:43.741054 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020127-915c-45e6-9736-e4d36e1ec4ba service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:43.741352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020127-915c-45e6-9736-e4d36e1ec4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:43.741627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020127-915c-45e6-9736-e4d36e1ec4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:43.750355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020127-915c-45e6-9736-e4d36e1ec4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:43.751873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020127-915c-45e6-9736-e4d36e1ec4ba service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:43.760729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1185/2376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:53.659226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:53.756965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=17 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:54.044631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:54.111142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01838-73e7-4432-a23c-5cdc4d0416ed None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:54.115599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:54.116475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.116755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.117047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] PATH_INFO: `/v3/users/fcb87db799d64a94945f85992f3ca01e` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.118264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb87db799d64a94945f85992f3ca01e)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:54.120214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:54.178127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb87db799d64a94945f85992f3ca01e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.179107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb87db799d64a94945f85992f3ca01e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.180098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb87db799d64a94945f85992f3ca01e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.191189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb87db799d64a94945f85992f3ca01e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.204511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb87db799d64a94945f85992f3ca01e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.221643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1192/2377] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:15:54 2022] DELETE /identity/v3/users/fcb87db799d64a94945f85992f3ca01e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:54.226407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.226702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.227002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.244406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:54.245641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:54.309118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1186/2378] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:54.321206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:54.322746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:54.381802 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f087e0-3dec-4caa-bbe7-2bc54c12950c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:54.386062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548318-5dc4-447f-904e-26e98ab84ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:54.386703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548318-5dc4-447f-904e-26e98ab84ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.386998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548318-5dc4-447f-904e-26e98ab84ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.387272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548318-5dc4-447f-904e-26e98ab84ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.396616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e548318-5dc4-447f-904e-26e98ab84ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:54.398145 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e548318-5dc4-447f-904e-26e98ab84ac8 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:54.408462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1193/2379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:15:54.720717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:54.722295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:54.734677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa30c6-39a5-44b6-8a88-0a355e926bc4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:54.740063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:54.740952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.741276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.741563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] PATH_INFO: `/v3/projects/dfef0c39f9fd4b759f5222b3cbdeeaff` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.743003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfef0c39f9fd4b759f5222b3cbdeeaff)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:54.744862 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:54.795343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfef0c39f9fd4b759f5222b3cbdeeaff', 'request_id': 'req-7b67e38e-d6b4-468b-be36-f6536ac199d1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.804266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfef0c39f9fd4b759f5222b3cbdeeaff', 'request_id': 'req-7b67e38e-d6b4-468b-be36-f6536ac199d1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.810952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfef0c39f9fd4b759f5222b3cbdeeaff', 'request_id': 'req-7b67e38e-d6b4-468b-be36-f6536ac199d1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.822329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] The token cache is being invalidate because project dfef0c39f9fd4b759f5222b3cbdeeaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:15:54.822623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.823327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7b67e38e-d6b4-468b-be36-f6536ac199d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:15:54.824998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1187/2380] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:15:54 2022] DELETE /identity/v3/projects/dfef0c39f9fd4b759f5222b3cbdeeaff => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:54.830054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.830529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.830631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.849308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:54.850532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:54.870018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:54.920696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1194/2381] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:54.928831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.929344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.929629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.950021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:54.950021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:54.958487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1188/2382] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:54.962895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:54.973120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4046d3-f5f7-4db8-b05f-a5924d203876 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:54.978369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:54.979072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:54.979360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:54.979641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:54.980481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:15:54.980675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:54.982401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:54.995552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1195/2383] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:15:55.001433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:55.013164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5c57b-948f-4c95-b0a3-1804b473b198 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:55.019024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:55.019683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.019961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.020230 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.020926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:55.022863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:55.054514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1189/2384] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:54 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:55.058864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:55.071636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6077a5-f915-49b7-866d-85afffd1c02e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:55.146415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:55.147125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.147406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.147656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.148369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:55.150523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:55.172314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1196/2385] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:55 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:55.176515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:55.187330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f51e-8ae7-4541-b950-cd9bf1d4dc04 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:55.192464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:55.193174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.193459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.193730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.194471 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:55.196084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:55.206959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1190/2386] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:55.211009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:55.221685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f29a99-3aa8-4f3d-93ac-564a3fdd3bc3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:55.227552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df8f10-c294-4743-94a1-a34903b04581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:55.228218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df8f10-c294-4743-94a1-a34903b04581 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.228500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df8f10-c294-4743-94a1-a34903b04581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.228773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df8f10-c294-4743-94a1-a34903b04581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.229539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df8f10-c294-4743-94a1-a34903b04581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:55.231152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df8f10-c294-4743-94a1-a34903b04581 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:55.243497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1197/2387] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:15:55.247997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:55.258720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d596e-b45b-45e7-9a32-85e9e6310cb9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:55.263633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:55.264522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.264801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.265103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] PATH_INFO: `/v3/projects/03491cee113744268fc89b63330c21c2/users/43f9e7923ebb4939ac2bd590270b48d7/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.280169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03491cee113744268fc89b63330c21c2, user_id=43f9e7923ebb4939ac2bd590270b48d7, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:55.282861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:55.298295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1191/2388] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:55 2022] PUT /identity/v3/projects/03491cee113744268fc89b63330c21c2/users/43f9e7923ebb4939ac2bd590270b48d7/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:15:55.303338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8bfc-df1e-4fda-aebf-8bebebc24c7c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.303634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8bfc-df1e-4fda-aebf-8bebebc24c7c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.303916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8bfc-df1e-4fda-aebf-8bebebc24c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.322890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3ebd8bfc-df1e-4fda-aebf-8bebebc24c7c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:55.324662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3ebd8bfc-df1e-4fda-aebf-8bebebc24c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:55.408614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1198/2389] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:15:55.418942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:55.420788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:55.448648 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:55.486070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bcd40-99db-494f-93a6-24b6a9463563 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:55.490313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:55.490971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:55.491260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:55.491533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:55.502429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:55.503880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:55.513907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1192/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:15:59.666503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:59.667005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:59.667118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:59.696821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] MFA Rules not processed for user `43f9e7923ebb4939ac2bd590270b48d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:15:59.697942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:15:59.717373 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:59.772003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1199/2391] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:15:59.776697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:59.786532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4efea-dd84-4dbc-afe8-73386401458b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:59.791204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:59.791892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:59.792148 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:59.792419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:59.793231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:59.795151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:59.826592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1193/2392] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:15:59 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:59.827912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:59.840085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c19ed-0767-4fff-b5b2-8388ccd390ae None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:59.898245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:59.898871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:59.899435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:59.899713 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:59.900415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:59.902383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:59.928110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1200/2393] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:15:59 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:15:59.929349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:59.940139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa898-0572-4519-9cb6-f49b0e367af0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:59.945049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:59.945925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:59.946268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:59.946517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:15:59.947261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:15:59.948893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:15:59.961863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1194/2394] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:15:59.966068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:15:59.976320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e2df3-bee7-45a0-a288-20e1808a3d0a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:15:59.981510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:15:59.982478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:15:59.982765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:15:59.983043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] PATH_INFO: `/v3/projects/defabc29eadd4d31b527fd0a1226fbd8/users/4a109c7db3b342f1bfed0dad57d690c2/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:00.000383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=defabc29eadd4d31b527fd0a1226fbd8, user_id=4a109c7db3b342f1bfed0dad57d690c2, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:00.003072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:00.021249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1201/2395] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:15:59 2022] PUT /identity/v3/projects/defabc29eadd4d31b527fd0a1226fbd8/users/4a109c7db3b342f1bfed0dad57d690c2/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:16:00.022709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:00.034333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8159d2-f5e3-4b1b-b184-4acc9e28ee0a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:00.107866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d486f-7126-4006-b9ba-879ed482b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:00.108555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d486f-7126-4006-b9ba-879ed482b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:00.108834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d486f-7126-4006-b9ba-879ed482b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:00.109144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d486f-7126-4006-b9ba-879ed482b5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:00.110339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d486f-7126-4006-b9ba-879ed482b5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:00.111752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d486f-7126-4006-b9ba-879ed482b5b6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:00.126344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1195/2396] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:16:00.130552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:00.141386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7e3a-7775-47b3-9149-8b8687ffb958 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:00.146161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:00.147063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:00.147342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:00.147614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] PATH_INFO: `/v3/projects/defabc29eadd4d31b527fd0a1226fbd8/users/4a109c7db3b342f1bfed0dad57d690c2/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:00.149947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=defabc29eadd4d31b527fd0a1226fbd8, user_id=4a109c7db3b342f1bfed0dad57d690c2, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:00.152493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:00.164347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1202/2397] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:16:00 2022] PUT /identity/v3/projects/defabc29eadd4d31b527fd0a1226fbd8/users/4a109c7db3b342f1bfed0dad57d690c2/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:16:05.159408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7e8a-da58-46c0-8230-a110f866f09f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:05.159919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7e8a-da58-46c0-8230-a110f866f09f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:05.160031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7e8a-da58-46c0-8230-a110f866f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:05.191291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-895e7e8a-da58-46c0-8230-a110f866f09f None None] MFA Rules not processed for user `4a109c7db3b342f1bfed0dad57d690c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:05.192531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-895e7e8a-da58-46c0-8230-a110f866f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:05.277385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1196/2398] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:16:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:16:05.291852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:05.293746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:05.371486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:05.402868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d572b-02ad-45b8-b998-f0ef01e563ca admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:05.408874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:05.409580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:05.409870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:05.410152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:05.477649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:05.479484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:05.489907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1203/2399] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:16:15.273220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:15.485088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=33 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:20.862077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87356ff-6848-4901-b569-50db65fdb814 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:20.862899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87356ff-6848-4901-b569-50db65fdb814 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:20.862899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87356ff-6848-4901-b569-50db65fdb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:20.917686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f87356ff-6848-4901-b569-50db65fdb814 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:20.918936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f87356ff-6848-4901-b569-50db65fdb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:20.991189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1197/2400] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:16:21.043889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:21.045579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:21.143630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d41f4c-3855-427f-a425-ae5a63cfbf07 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:21.149604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945feed-288f-4875-bf67-a9d4d3b97314 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:21.150253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945feed-288f-4875-bf67-a9d4d3b97314 service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:21.150535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945feed-288f-4875-bf67-a9d4d3b97314 service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:21.150794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945feed-288f-4875-bf67-a9d4d3b97314 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:21.159845 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945feed-288f-4875-bf67-a9d4d3b97314 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:21.161461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945feed-288f-4875-bf67-a9d4d3b97314 service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:21.169860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1204/2401] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:16:30.985656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=40 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:31.166261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=41 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:31.336698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7eb81-c51a-4ccd-956c-66908fd465b8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:31.336990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7eb81-c51a-4ccd-956c-66908fd465b8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:31.337298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7eb81-c51a-4ccd-956c-66908fd465b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:31.355804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cce7eb81-c51a-4ccd-956c-66908fd465b8 None None] MFA Rules not processed for user `43f9e7923ebb4939ac2bd590270b48d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:31.357183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cce7eb81-c51a-4ccd-956c-66908fd465b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:31.364332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1198/2402] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:16:38.895374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad90ff-4971-4bee-823d-bd504cdabb43 None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:38.896013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad90ff-4971-4bee-823d-bd504cdabb43 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:38.896013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad90ff-4971-4bee-823d-bd504cdabb43 None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:38.897520 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1205/2403] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:16:38.904666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3395927-73e3-4a27-8abb-dae2c06e440a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:38.905501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3395927-73e3-4a27-8abb-dae2c06e440a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:38.905786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3395927-73e3-4a27-8abb-dae2c06e440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:38.951616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a3395927-73e3-4a27-8abb-dae2c06e440a None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:38.952950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a3395927-73e3-4a27-8abb-dae2c06e440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:38.964854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1199/2404] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:16:38.978683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad90ff-4971-4bee-823d-bd504cdabb43 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:38.981606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f7ad90ff-4971-4bee-823d-bd504cdabb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:39.050071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad90ff-4971-4bee-823d-bd504cdabb43 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:39.054022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5034-f67c-49c5-a161-6c2970f7a6d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:39.054876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5034-f67c-49c5-a161-6c2970f7a6d1 service glance] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.055221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5034-f67c-49c5-a161-6c2970f7a6d1 service glance] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.055561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5034-f67c-49c5-a161-6c2970f7a6d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.066444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5034-f67c-49c5-a161-6c2970f7a6d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:39.068081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5034-f67c-49c5-a161-6c2970f7a6d1 service glance] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:39.093406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1206/2405] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:16:39.168326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05443f0e-7bac-4eda-b89b-3d139fde01e6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.168728 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05443f0e-7bac-4eda-b89b-3d139fde01e6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.169234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05443f0e-7bac-4eda-b89b-3d139fde01e6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.170801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1200/2406] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:16:39.175948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901bc6-6a59-41ad-951e-b606d20dfb19 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.176226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901bc6-6a59-41ad-951e-b606d20dfb19 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.176803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901bc6-6a59-41ad-951e-b606d20dfb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.198799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6e901bc6-6a59-41ad-951e-b606d20dfb19 None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:39.200217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6e901bc6-6a59-41ad-951e-b606d20dfb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:39.272042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1207/2407] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:16:39.287380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05443f0e-7bac-4eda-b89b-3d139fde01e6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:39.289299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-05443f0e-7bac-4eda-b89b-3d139fde01e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:39.313970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05443f0e-7bac-4eda-b89b-3d139fde01e6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:39.320305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795c0f-45b3-48da-8a95-f7fdc5c1de18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:39.321134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795c0f-45b3-48da-8a95-f7fdc5c1de18 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.321524 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795c0f-45b3-48da-8a95-f7fdc5c1de18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.321893 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795c0f-45b3-48da-8a95-f7fdc5c1de18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.333162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f795c0f-45b3-48da-8a95-f7fdc5c1de18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:39.334618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f795c0f-45b3-48da-8a95-f7fdc5c1de18 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:39.343559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1201/2408] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:16:39.437461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4210a6-4abc-4b97-b67c-9d3ca5839cbe None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.437831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4210a6-4abc-4b97-b67c-9d3ca5839cbe None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.438175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4210a6-4abc-4b97-b67c-9d3ca5839cbe None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.439641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1208/2409] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:16:39.445760 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb571938-ce11-4bed-a7e9-5dbfde89ed24 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.446053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb571938-ce11-4bed-a7e9-5dbfde89ed24 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.446331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb571938-ce11-4bed-a7e9-5dbfde89ed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.465561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-eb571938-ce11-4bed-a7e9-5dbfde89ed24 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:39.466866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-eb571938-ce11-4bed-a7e9-5dbfde89ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:39.478136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1202/2410] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:16:39.489275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4210a6-4abc-4b97-b67c-9d3ca5839cbe None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:39.503553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4210a6-4abc-4b97-b67c-9d3ca5839cbe None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:39.508292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:39.508958 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:39.509384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:39.509749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:39.520849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:39.522399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:39.533576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1209/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:16:42.671939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:42.672504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:42.672504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:42.698927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:16:42.700320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:42.708689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1203/2412] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:16:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:16:42.721136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:42.733478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd0e2b-7a3b-44ba-a9ea-d72411acfb99 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:42.739760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:42.740445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:42.740724 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:42.740997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:42.750516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:42.752246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:42.763038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1210/2413] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:16:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:16:46.766400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:46.777457 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cc357-7922-4c0e-a0be-af6a59b7ca6e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:46.781871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:46.782894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:46.783176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:46.783451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:46.785356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:46.805325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:46.806989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:46.821349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1204/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:16:48.503280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:48.517113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8146a18-d689-400d-91e2-558e24a5146d service swift] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:48.522915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:48.524198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:48.524720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:48.525361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:48.528888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:48.546667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:48.548154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:48.560094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1211/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:16:56.815584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=30 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:58.554731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=67 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:59.324990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:16:59.326460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:59.390800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d69ab-743e-4bd2-b9fc-c98f54ee027b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:16:59.395330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:16:59.396117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:16:59.396392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:16:59.396673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:16:59.398691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:16:59.475647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:16:59.477176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:16:59.487133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1205/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:17:01.574923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:01.593181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5d3d2-fc23-4567-8d8a-f420dc600e89 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:01.605604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:01.605604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:01.605604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:01.606059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:01.612725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:01.682112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:01.683734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:01.693493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1212/2417] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:17:01.798944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:01.809455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36332-241d-4926-8630-a00433f4b3f2 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:01.813890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:01.814676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:01.814960 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:01.815228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:01.817499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:01.828646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:01.830153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:01.839438 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1206/2418] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:17:06.046595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:06.056926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793c9b-0cd0-4682-be6b-8e0f39089877 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:06.061389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fd59d-63d6-4cb7-bebf-ad13ea91f1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:06.062052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd59d-63d6-4cb7-bebf-ad13ea91f1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:06.062325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd59d-63d6-4cb7-bebf-ad13ea91f1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:06.062601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd59d-63d6-4cb7-bebf-ad13ea91f1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:06.072963 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fd59d-63d6-4cb7-bebf-ad13ea91f1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:06.074447 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fd59d-63d6-4cb7-bebf-ad13ea91f1fc service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:06.085260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1213/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:17:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:17:08.291412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:08.294287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:08.311832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1ab5-ac23-4e44-8a0d-0b4853b18ce0 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:08.318060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:08.318791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:08.319261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:08.319566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:08.321444 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:08.333988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:08.335604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:08.346326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1207/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:17:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:17:12.573137 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71a616-a0df-48f8-be33-51e81b0b882b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:12.573668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71a616-a0df-48f8-be33-51e81b0b882b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:12.573668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71a616-a0df-48f8-be33-51e81b0b882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:12.592437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-9a71a616-a0df-48f8-be33-51e81b0b882b None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:17:12.593655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9a71a616-a0df-48f8-be33-51e81b0b882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:12.601100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1214/2421] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jun 7 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:17:12.618677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:12.631041 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47492be-5cb3-4d99-a7dd-81df56d20f4d service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:12.637503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:12.638152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:12.638436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:12.638710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:12.647235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:12.649000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:12.657251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1208/2422] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:17:22.587072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=37 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:22.654123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=66 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:27.620096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:27.620966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:27.620966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:27.639852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] MFA Rules not processed for user `025ca1d10d5e49e984c7fd4e0b425f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:17:27.641150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:27.649202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1215/2423] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:17:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:17:37.635169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:47.558977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:47.572091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef45db0-e871-4ce4-a6a7-f9563046ef17 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:47.578564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:47.579223 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:47.579496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:47.579770 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:47.581744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:47.651895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:47.653916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f390ca-1809-4691-9424-31b25d7e81fc service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:47.663579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1209/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:17:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:17:57.659171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=28 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:59.948218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:17:59.958907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e105ec-7726-49d5-8c38-837a2f67a083 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:17:59.962986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:17:59.963645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:17:59.963929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:17:59.964201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:17:59.966161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:17:59.976920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:17:59.978429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1e836-3489-4db1-9254-b8b995876739 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:17:59.986727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1216/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:00.102339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963366-c96b-4180-91db-e1ef9b3d40cb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.103083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963366-c96b-4180-91db-e1ef9b3d40cb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.103607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963366-c96b-4180-91db-e1ef9b3d40cb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.105384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1210/2426] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:18:00.112014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9dca-8ddd-4dc9-8d3c-536dbf9fda6e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.112293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9dca-8ddd-4dc9-8d3c-536dbf9fda6e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.112574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9dca-8ddd-4dc9-8d3c-536dbf9fda6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.133104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-93ee9dca-8ddd-4dc9-8d3c-536dbf9fda6e None None] MFA Rules not processed for user `36b7fcbf1a134a5a874da581578981d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:00.134674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-93ee9dca-8ddd-4dc9-8d3c-536dbf9fda6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:00.142696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1217/2427] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:18:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:18:00.156368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963366-c96b-4180-91db-e1ef9b3d40cb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:00.180582 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963366-c96b-4180-91db-e1ef9b3d40cb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:00.186232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce066e-20c7-4037-b2bd-daf4a8549653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:00.187127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce066e-20c7-4037-b2bd-daf4a8549653 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.187673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce066e-20c7-4037-b2bd-daf4a8549653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.188009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce066e-20c7-4037-b2bd-daf4a8549653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.197097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce066e-20c7-4037-b2bd-daf4a8549653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:00.198555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce066e-20c7-4037-b2bd-daf4a8549653 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:00.208610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1211/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:00.330793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5b71-0a42-465e-896d-fcd623c6d5fc None None] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.331162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5b71-0a42-465e-896d-fcd623c6d5fc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.331514 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5b71-0a42-465e-896d-fcd623c6d5fc None None] PATH_INFO: `/` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.333002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1218/2429] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jun 7 13:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 13:18:00.338744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.338981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.339425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.361225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] MFA Rules not processed for user `4bfe0c829ddb45cbb59b275e4c8349f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:00.362472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:00.373318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1212/2430] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jun 7 13:18:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:18:00.383791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5b71-0a42-465e-896d-fcd623c6d5fc None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:00.394872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5b71-0a42-465e-896d-fcd623c6d5fc None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:00.398427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:00.399073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.399356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.399632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.410526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:00.411964 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:00.423263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1219/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:00.488593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:00.490291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:00.568491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3117d6-d5c5-430e-a2ba-1f19adf4bfb7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:00.574306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:00.575168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:00.575556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:00.575935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:00.578822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:00.591683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:00.593595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be87b4-3d88-4849-b4ef-4120704f2d2f service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:00.605270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1213/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:01.697037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:01.709146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01af1-d128-4e87-91ad-f2d1698b7beb service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:01.714830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:01.715616 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:01.715898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:01.716172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:01.718210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:01.730796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:01.732391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:01.743278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1220/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:10.601143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=41 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:11.738807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=21 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:22.079973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:22.080496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:22.080598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:22.110683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] MFA Rules not processed for user `8b341180925b454094d9bf5e6f5b3eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:22.112197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:22.120420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1214/2434] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:18:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:18:22.449793 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:22.460443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2354b1e-1f05-4840-8d0d-ffd2ad536036 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:22.464599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:22.465288 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:22.465570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:22.465842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:22.467898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:22.478066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:22.479504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:22.487846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1221/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:32.099786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:32.484375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=6 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:35.264486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:35.279146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b435c-8788-449c-9c4e-d9f891367460 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:35.284881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:35.285622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:35.285998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:35.286372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:35.296619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:35.301871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:35.303788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:35.315973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1215/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:45.311015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:49.175246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:49.184108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7200e-a7c3-4fd2-9e21-0757ecb8a65a service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:49.188329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:49.188979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:49.189291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:49.189560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:49.191680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:49.263985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:49.265604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:49.276133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1222/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:18:53.028646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.030244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:53.046205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e6a65-c53c-4868-a4ea-0df1d733c3d4 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.050586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.051498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.051774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.052043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] PATH_INFO: `/v3/users/025ca1d10d5e49e984c7fd4e0b425f08` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.053242 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025ca1d10d5e49e984c7fd4e0b425f08)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.055157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.102627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025ca1d10d5e49e984c7fd4e0b425f08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.103392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025ca1d10d5e49e984c7fd4e0b425f08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.104100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025ca1d10d5e49e984c7fd4e0b425f08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.111599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025ca1d10d5e49e984c7fd4e0b425f08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.125132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab6a5563-fe4b-4424-b993-9a00bc703409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025ca1d10d5e49e984c7fd4e0b425f08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.140455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1216/2438] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:18:53 2022] DELETE /identity/v3/users/025ca1d10d5e49e984c7fd4e0b425f08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:18:53.319801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.330997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4681f-4f7f-4f8b-9ab1-182351f4f158 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.388938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.389840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.390124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.390406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] PATH_INFO: `/v3/projects/f9cf247a413d45049be49368cbce7213` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.391581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cf247a413d45049be49368cbce7213)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.393529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.442051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cf247a413d45049be49368cbce7213', 'request_id': 'req-a8315419-f2d8-4646-8694-37798607481f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.450281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cf247a413d45049be49368cbce7213', 'request_id': 'req-a8315419-f2d8-4646-8694-37798607481f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.456396 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cf247a413d45049be49368cbce7213', 'request_id': 'req-a8315419-f2d8-4646-8694-37798607481f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.468119 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] The token cache is being invalidate because project f9cf247a413d45049be49368cbce7213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:18:53.468407 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.469224 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a8315419-f2d8-4646-8694-37798607481f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:18:53.470873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1223/2439] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:18:53 2022] DELETE /identity/v3/projects/f9cf247a413d45049be49368cbce7213 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:18:53.476028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.476320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.476599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.498591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:53.500021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:53.567639 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1217/2440] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:18:53.576465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.576767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.577052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.596644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:53.597889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:53.606486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1224/2441] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:18:53.611134 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.621715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213171-770d-4789-ba9d-2b371d300bbd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.626604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.627260 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.627517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.627805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.628539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:18:53.628845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.630496 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.642696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1218/2442] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:18:53.647863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.661862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370481c-0b13-4dc4-94b3-0b06eb128d0c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.668117 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.668757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.669064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.669340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.670029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.671925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.685709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:53.713631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1225/2443] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:18:53 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:18:53.714873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.725278 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ec66-6678-4e7b-a758-54f5cd99a5d1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.786396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.787071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.787351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.787623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.788317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.790343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.797787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:53.818516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1219/2444] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:18:53 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:18:53.820292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.831594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad1370-fd56-46c4-9869-ef1d9464e99b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.837363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.838009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.838309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.838578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.839302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.840966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.851322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1226/2445] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:18:53.855766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.865944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9b6b9-705a-4b84-a127-b35a8b536fd4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.871467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636ca26-a153-4706-9814-3edec88c9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.872128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636ca26-a153-4706-9814-3edec88c9d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.872412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636ca26-a153-4706-9814-3edec88c9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.872685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636ca26-a153-4706-9814-3edec88c9d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.873464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636ca26-a153-4706-9814-3edec88c9d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.875080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636ca26-a153-4706-9814-3edec88c9d65 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.888056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1220/2446] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:18:53.892669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:53.903706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8320cde-5abb-4163-b538-1b59519db050 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:53.909635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:53.910528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.910813 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.911094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] PATH_INFO: `/v3/projects/0fa6e76580734bf5980477d32c87bfc1/users/bf1524fd1042430e97bb60caafef26f3/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.929877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa6e76580734bf5980477d32c87bfc1, user_id=bf1524fd1042430e97bb60caafef26f3, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:53.934157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:53.953923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1227/2447] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:18:53 2022] PUT /identity/v3/projects/0fa6e76580734bf5980477d32c87bfc1/users/bf1524fd1042430e97bb60caafef26f3/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:18:53.959198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a903bad-35dc-4ee8-9d75-450a4227d8be None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:53.959492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a903bad-35dc-4ee8-9d75-450a4227d8be None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:53.959772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a903bad-35dc-4ee8-9d75-450a4227d8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:53.978208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2a903bad-35dc-4ee8-9d75-450a4227d8be None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:53.979449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2a903bad-35dc-4ee8-9d75-450a4227d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:54.041169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1221/2448] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:18:54.051053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:54.053146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:54.114723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d6536-265a-4662-9e5a-a682c48fde98 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:54.119417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:54.120172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:54.120456 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:54.120732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:54.131253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:54.132725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:54.143368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1228/2449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:58.198309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d04bbd-4e36-409d-a2e2-ed51ee7ee5ba None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:58.198891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d04bbd-4e36-409d-a2e2-ed51ee7ee5ba None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:58.198891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d04bbd-4e36-409d-a2e2-ed51ee7ee5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:58.229926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-13d04bbd-4e36-409d-a2e2-ed51ee7ee5ba None None] MFA Rules not processed for user `bf1524fd1042430e97bb60caafef26f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:58.231153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-13d04bbd-4e36-409d-a2e2-ed51ee7ee5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:58.318511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1222/2450] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:18:58.335757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:18:58.338156 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:58.420809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390768ae-e376-4160-863a-337f84c5f5a1 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:18:58.426549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b773c-a02a-4dbc-bb3d-908d8574c76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:18:58.427232 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b773c-a02a-4dbc-bb3d-908d8574c76d service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:58.427516 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b773c-a02a-4dbc-bb3d-908d8574c76d service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:58.427783 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b773c-a02a-4dbc-bb3d-908d8574c76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:58.437733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b773c-a02a-4dbc-bb3d-908d8574c76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:18:58.439391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b773c-a02a-4dbc-bb3d-908d8574c76d service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:18:58.449763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1229/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:18:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:18:59.791262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43c2df-19d8-4700-b7f1-a385e1250f3a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:18:59.791732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43c2df-19d8-4700-b7f1-a385e1250f3a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:18:59.791854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43c2df-19d8-4700-b7f1-a385e1250f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:18:59.810044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3e43c2df-19d8-4700-b7f1-a385e1250f3a None None] MFA Rules not processed for user `bf1524fd1042430e97bb60caafef26f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:18:59.812714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3e43c2df-19d8-4700-b7f1-a385e1250f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:18:59.820619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1223/2452] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:19:06.763808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:19:06.764562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:19:06.764799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:19:06.785831 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] MFA Rules not processed for user `e1e6349a50ec4554b27b94b3f0f2dcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:19:06.786940 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:19:06.820905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:06.843347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1230/2453] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:19:09.804456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:16.836708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:40.007573 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:19:40.008052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:19:40.008143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:19:40.027110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] MFA Rules not processed for user `43f9e7923ebb4939ac2bd590270b48d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:19:40.028550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:19:40.085586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1224/2454] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:19:50.077832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=25 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:50.881999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:19:50.883728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:19:50.959233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88eabe-f6c6-4219-bb6b-10cb529de302 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:19:50.964848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:19:50.965626 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:19:50.965911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:19:50.966178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:19:50.967999 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:19:50.979946 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:19:50.981556 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:19:50.991450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1231/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:19:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:20:00.298464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:00.300146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:00.313984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11944fa2-47d2-44b4-82b7-77273b5df7fb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:00.318697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:00.319346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:00.319629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:00.319899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:00.324679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:00.407942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:00.409416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:00.421097 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1225/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:20:00.987305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=32 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:05.576332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:05.585929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e136a3-ac8e-4412-9ee9-755effd37d8a service placement] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:05.589784 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:05.590434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:05.590755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:05.591026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:05.592913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:05.605355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:05.606794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:05.616525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1232/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:20:09.036991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:09.049991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adea79-0df3-4a12-b004-1ed6fabb3d5e service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:09.056818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:09.057797 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:09.058271 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:09.058681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:09.060984 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:09.074052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:09.076067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:09.091879 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1226/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:20:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:20:12.760014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:12.761753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:12.776596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59129-583a-42ec-9a61-5870ddd979c2 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:12.781538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:12.782536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:12.782891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:12.783230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] PATH_INFO: `/v3/users/f75d5fe118b348098ac701778e552da7` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:12.784440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75d5fe118b348098ac701778e552da7)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:12.786445 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:12.846260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75d5fe118b348098ac701778e552da7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:12.846966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75d5fe118b348098ac701778e552da7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:12.847591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75d5fe118b348098ac701778e552da7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:12.857206 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75d5fe118b348098ac701778e552da7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:12.877255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75d5fe118b348098ac701778e552da7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:12.893826 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1233/2459] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:20:12 2022] DELETE /identity/v3/users/f75d5fe118b348098ac701778e552da7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:20:13.150584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:13.163016 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae2b69-313b-4df0-b66d-32a8553cde7f service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:13.234163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:13.235036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:13.235363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:13.235631 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] PATH_INFO: `/v3/projects/01f471802c1e4d5393928e42b59b2962` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:13.236858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f471802c1e4d5393928e42b59b2962)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:13.238793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:13.306891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f471802c1e4d5393928e42b59b2962', 'request_id': 'req-8bb44c7a-9c32-49bb-a685-0453a57b133e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.316434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f471802c1e4d5393928e42b59b2962', 'request_id': 'req-8bb44c7a-9c32-49bb-a685-0453a57b133e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.322630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f471802c1e4d5393928e42b59b2962', 'request_id': 'req-8bb44c7a-9c32-49bb-a685-0453a57b133e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.334055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] The token cache is being invalidate because project 01f471802c1e4d5393928e42b59b2962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:20:13.334327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.334997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.336998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1227/2460] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:20:13 2022] DELETE /identity/v3/projects/01f471802c1e4d5393928e42b59b2962 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:20:13.341329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:13.342887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:13.356016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3555c-f3fd-49c4-ac3f-7c8dbcca1ac0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:13.423063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:13.424197 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:13.424546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:13.424966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] PATH_INFO: `/v3/users/828a3e4cae9c4ed1b1a0ca3e7adcf792` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:13.426887 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828a3e4cae9c4ed1b1a0ca3e7adcf792)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:13.429961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:13.479906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828a3e4cae9c4ed1b1a0ca3e7adcf792'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.480543 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828a3e4cae9c4ed1b1a0ca3e7adcf792'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.481166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828a3e4cae9c4ed1b1a0ca3e7adcf792'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.487837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828a3e4cae9c4ed1b1a0ca3e7adcf792'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.492785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:13.502883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9218c527-bb50-47c2-9014-20b8ffff4ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828a3e4cae9c4ed1b1a0ca3e7adcf792'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.517435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1234/2461] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:20:13 2022] DELETE /identity/v3/users/828a3e4cae9c4ed1b1a0ca3e7adcf792 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:20:13.698139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:13.699772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:13.715694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44c7a-9c32-49bb-a685-0453a57b133e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:13.730891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:13.779517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:13.780394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:13.780682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:13.780967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] PATH_INFO: `/v3/projects/266edb9ac8ab4ecfa249c2bc28af860c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:13.782202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=266edb9ac8ab4ecfa249c2bc28af860c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:13.784099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:13.833117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266edb9ac8ab4ecfa249c2bc28af860c', 'request_id': 'req-0078fdaf-302a-42db-bb09-fdd343182c7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.842570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266edb9ac8ab4ecfa249c2bc28af860c', 'request_id': 'req-0078fdaf-302a-42db-bb09-fdd343182c7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.848111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266edb9ac8ab4ecfa249c2bc28af860c', 'request_id': 'req-0078fdaf-302a-42db-bb09-fdd343182c7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.859241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] The token cache is being invalidate because project 266edb9ac8ab4ecfa249c2bc28af860c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:20:13.859523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.860143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:20:13.861748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1228/2462] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:20:13 2022] DELETE /identity/v3/projects/266edb9ac8ab4ecfa249c2bc28af860c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:20:18.734422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92272-e0ed-4e38-81f9-45d82228b6d0 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:18.734960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92272-e0ed-4e38-81f9-45d82228b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:18.734960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92272-e0ed-4e38-81f9-45d82228b6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:18.755412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b8a92272-e0ed-4e38-81f9-45d82228b6d0 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:20:18.756644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b8a92272-e0ed-4e38-81f9-45d82228b6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:18.816822 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1235/2463] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:20:18.865245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:18.866739 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:18.943807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fdaf-302a-42db-bb09-fdd343182c7d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:18.949901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:18.950577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:18.950857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:18.951135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:18.960858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:18.962627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:18.975846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1229/2464] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:20:28.809857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=3,keystone:SELECT=31,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:28.969607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:35.806133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93157ff-d110-4a42-a895-9a143f827046 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:35.806939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93157ff-d110-4a42-a895-9a143f827046 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:35.806939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93157ff-d110-4a42-a895-9a143f827046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:35.828671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-b93157ff-d110-4a42-a895-9a143f827046 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:20:35.830070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b93157ff-d110-4a42-a895-9a143f827046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:35.838941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1236/2465] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:20:35.851850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:35.871391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30082-2806-4a01-b0c9-239f10bd4953 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:35.877671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cc059-836d-476b-9f53-1dd3c656c363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:35.878345 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc059-836d-476b-9f53-1dd3c656c363 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:35.878630 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc059-836d-476b-9f53-1dd3c656c363 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:35.878909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc059-836d-476b-9f53-1dd3c656c363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:35.894051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cc059-836d-476b-9f53-1dd3c656c363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:35.897227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cc059-836d-476b-9f53-1dd3c656c363 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:35.908508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1230/2466] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:20:45.821924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:45.904234 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:53.975837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:53.976387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:53.976387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:53.995998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] MFA Rules not processed for user `bf1524fd1042430e97bb60caafef26f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:20:53.997245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:54.056054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1237/2467] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:20:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:20:56.171380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:56.171919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:56.171919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:56.194945 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:20:56.196166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:20:56.204995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1231/2468] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jun 7 13:20:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:20:56.217495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:20:56.231204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dab75-0cb7-49d9-a642-bb15198e84a9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:20:56.236602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:20:56.237295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:20:56.237588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:20:56.237861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:20:56.246752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:20:56.248389 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:20:56.256507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1238/2469] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:06.188682 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:06.253567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=31 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:22.062116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:22.063620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:22.125905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714afd-c0bc-45a1-889c-d9000e52421f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:22.130385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:22.131028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:22.131306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:22.131579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:22.133521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:22.221553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:22.223293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:22.234946 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1232/2470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:25.707876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:25.710597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:25.725470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc13c6-049b-4cc4-88c8-c702e19c9734 service swift] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:25.730313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:25.731265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:25.731554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:25.731835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] PATH_INFO: `/v3/users/e1e6349a50ec4554b27b94b3f0f2dcbd` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:25.733087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e6349a50ec4554b27b94b3f0f2dcbd)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:25.735080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:25.795528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e6349a50ec4554b27b94b3f0f2dcbd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:25.796322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e6349a50ec4554b27b94b3f0f2dcbd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:25.796971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e6349a50ec4554b27b94b3f0f2dcbd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:25.804763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e6349a50ec4554b27b94b3f0f2dcbd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:25.818799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-16ee18a5-5fce-43a8-b7c0-fc4ef2fb4a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e6349a50ec4554b27b94b3f0f2dcbd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:25.834463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1239/2471] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:25 2022] DELETE /identity/v3/users/e1e6349a50ec4554b27b94b3f0f2dcbd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:26.022788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.035435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3f029-9046-47ce-9186-92e0b2b134e4 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.099182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.100351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.100695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.101128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] PATH_INFO: `/v3/projects/63d29a15ba1f484fbd98c93d98b42c7e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.102729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d29a15ba1f484fbd98c93d98b42c7e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.104927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.153181 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d29a15ba1f484fbd98c93d98b42c7e', 'request_id': 'req-7706bac3-7159-4ee6-9350-8daab1a6d098'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:26.155679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:26.161628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d29a15ba1f484fbd98c93d98b42c7e', 'request_id': 'req-7706bac3-7159-4ee6-9350-8daab1a6d098'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:26.168542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d29a15ba1f484fbd98c93d98b42c7e', 'request_id': 'req-7706bac3-7159-4ee6-9350-8daab1a6d098'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:26.180100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] The token cache is being invalidate because project 63d29a15ba1f484fbd98c93d98b42c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:26.180382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:26.181102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7706bac3-7159-4ee6-9350-8daab1a6d098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:26.182717 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1233/2472] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:26 2022] DELETE /identity/v3/projects/63d29a15ba1f484fbd98c93d98b42c7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:26.187707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.187989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.188264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.208469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:26.209628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:26.275478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1240/2473] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:26.285299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.285927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.286397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.309888 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:26.311298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:26.321599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1234/2474] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:26.326549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.336728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313d20-4ee3-48c6-8c85-4fc748baba9c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.342045 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.342722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.343006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.343280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.344028 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:21:26.344332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.346016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.358911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1241/2475] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:21:26.364564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.374655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345f73b-291a-49f5-bf03-8a48b9edb995 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.380406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.381080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.381387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.381679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.382366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.384263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.416259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1235/2476] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:26.420691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.431532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a0871-cbbe-4864-a7f1-e4045ab7dab7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.503031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.503704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.503983 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.504283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.504982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.506944 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.513776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:26.531195 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1242/2477] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:26.536019 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.547321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554d6cb-9c97-422c-9ff3-766a4dbb5a1a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.553101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.553778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.554083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.554347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.555095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.556713 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.568491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1236/2478] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:26.572824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.585318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0cf28-884a-40ae-8401-9dfb85b7c163 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.592276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b6e1d-c678-4bcd-b967-f4ef00a0383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.592961 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6e1d-c678-4bcd-b967-f4ef00a0383b admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.593272 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6e1d-c678-4bcd-b967-f4ef00a0383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.593549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6e1d-c678-4bcd-b967-f4ef00a0383b admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.594293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b6e1d-c678-4bcd-b967-f4ef00a0383b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.596110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b6e1d-c678-4bcd-b967-f4ef00a0383b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.607338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1243/2479] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:26.611834 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.623243 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99442eba-59f2-476e-8769-af2726cdd275 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.628367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.629300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.629578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.629849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] PATH_INFO: `/v3/projects/e4e452e3248f45d6b7cfb81b8237ea28/users/d8cf4cc06cd6419aab2629bd13c13fbb/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.645953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e452e3248f45d6b7cfb81b8237ea28, user_id=d8cf4cc06cd6419aab2629bd13c13fbb, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.648593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.664755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1237/2480] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:26 2022] PUT /identity/v3/projects/e4e452e3248f45d6b7cfb81b8237ea28/users/d8cf4cc06cd6419aab2629bd13c13fbb/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:26.675130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.675422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.675751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.706053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] MFA Rules not processed for user `d8cf4cc06cd6419aab2629bd13c13fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:26.707315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:26.779732 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1244/2481] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:26.784715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.854342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6a99-73ca-4886-b9f9-9cfe44ec2983 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.859333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.860077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.860419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.860701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.861516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.863547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.894324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1238/2482] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:26.898486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:26.909666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37572d27-b688-4731-b9e5-2db32a48a37f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:26.969150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:26.969850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:26.970134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:26.970431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:26.971293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:26.973106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:26.996430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1245/2483] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:26 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:27.000943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:27.012103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3b681-b603-4ce1-b471-8477a17b14e6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:27.019417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:27.020139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.020455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.020738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.021508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:27.023130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:27.035678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1239/2484] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:27.041094 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:27.052105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3137cb-e2af-468f-a3ce-24149a26039c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:27.057680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:27.058696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.058978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.059256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] PATH_INFO: `/v3/projects/f2d02bef8d054213b46b175de1deffcc/users/f3a9fcea26b9441986bfc932703fc41d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.079951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d02bef8d054213b46b175de1deffcc, user_id=f3a9fcea26b9441986bfc932703fc41d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:27.082905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:27.100558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1246/2485] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:27 2022] PUT /identity/v3/projects/f2d02bef8d054213b46b175de1deffcc/users/f3a9fcea26b9441986bfc932703fc41d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:27.104941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:27.118298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a19d2-2f65-496e-aa5b-ae13052b7ad8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:27.171372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:27.183281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bc348-bae0-4a7b-89e4-e605f5324c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:27.183964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bc348-bae0-4a7b-89e4-e605f5324c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.184248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bc348-bae0-4a7b-89e4-e605f5324c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.184521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bc348-bae0-4a7b-89e4-e605f5324c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.185293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bc348-bae0-4a7b-89e4-e605f5324c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:27.186891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bc348-bae0-4a7b-89e4-e605f5324c74 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:27.196944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1240/2486] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:21:27.202501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:27.213386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ff19-6007-4c55-a7b5-6221828c12f9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:27.219135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:27.220032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.220308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.220578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] PATH_INFO: `/v3/projects/f2d02bef8d054213b46b175de1deffcc/users/f3a9fcea26b9441986bfc932703fc41d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.222701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d02bef8d054213b46b175de1deffcc, user_id=f3a9fcea26b9441986bfc932703fc41d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:27.225467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:27.236976 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1247/2487] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:27 2022] PUT /identity/v3/projects/f2d02bef8d054213b46b175de1deffcc/users/f3a9fcea26b9441986bfc932703fc41d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:27.249173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.249567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.249955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.280596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] MFA Rules not processed for user `f3a9fcea26b9441986bfc932703fc41d`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:27.281956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:27.354952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1241/2488] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:21:27.368794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:27.371418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:27.396073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:27.434645 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667c50f-3f65-4641-9f35-e9af1fc02fed admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:27.438666 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:27.439323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.439604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.439957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.449390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:27.450838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:27.461970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1248/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:27.538884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:27.552255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb2a4-ca09-4d28-b6c7-8b10fe23ce70 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:27.555920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e3dbb-6807-453c-b8b0-a42bacb2741a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:27.556617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e3dbb-6807-453c-b8b0-a42bacb2741a service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:27.556904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e3dbb-6807-453c-b8b0-a42bacb2741a service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:27.557208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e3dbb-6807-453c-b8b0-a42bacb2741a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:27.616382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e3dbb-6807-453c-b8b0-a42bacb2741a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:27.617927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e3dbb-6807-453c-b8b0-a42bacb2741a service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:27.628191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1242/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:37.456410 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=17 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:37.623171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=68 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:39.173327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:39.242354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf709c-ef6c-4401-ab16-4c600f02af5e service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:39.248188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:39.249072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:39.249349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:39.249620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] PATH_INFO: `/v3/users/d8cf4cc06cd6419aab2629bd13c13fbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:39.250916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8cf4cc06cd6419aab2629bd13c13fbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:39.252844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:39.306291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8cf4cc06cd6419aab2629bd13c13fbb'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.307048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8cf4cc06cd6419aab2629bd13c13fbb'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.308115 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8cf4cc06cd6419aab2629bd13c13fbb'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.316220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8cf4cc06cd6419aab2629bd13c13fbb'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.336037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8cf4cc06cd6419aab2629bd13c13fbb'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.354821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1249/2491] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:39 2022] DELETE /identity/v3/users/d8cf4cc06cd6419aab2629bd13c13fbb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:39.361092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:39.361578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:39.361701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:39.385205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:39.386422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:39.458746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1243/2492] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:39.470020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:39.471670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:39.534459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99324d-c69d-437d-8493-3bce6a55619b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:39.538657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:39.539310 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:39.539593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:39.539870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:39.549285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:39.550737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:39.560354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1250/2493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:39.855004 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:39.856678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:39.873664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb8ce-b498-429a-bbbe-bd2d79352eea None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:39.880475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:39.881789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:39.882210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:39.882690 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] PATH_INFO: `/v3/projects/e4e452e3248f45d6b7cfb81b8237ea28` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:39.884817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e452e3248f45d6b7cfb81b8237ea28)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:39.889246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:39.939056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e452e3248f45d6b7cfb81b8237ea28', 'request_id': 'req-43260886-6453-4784-acc9-ebe727487f56'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.947610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e452e3248f45d6b7cfb81b8237ea28', 'request_id': 'req-43260886-6453-4784-acc9-ebe727487f56'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.953795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e452e3248f45d6b7cfb81b8237ea28', 'request_id': 'req-43260886-6453-4784-acc9-ebe727487f56'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.968214 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] The token cache is being invalidate because project e4e452e3248f45d6b7cfb81b8237ea28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:39.968982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.969270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:39.971464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1244/2494] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:39 2022] DELETE /identity/v3/projects/e4e452e3248f45d6b7cfb81b8237ea28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:39.976477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:39.986945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254bd3e-18cb-496d-9e8f-70793c69c950 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:40.008904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:40.053343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:40.054134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.054418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.054687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] PATH_INFO: `/v3/users/f3a9fcea26b9441986bfc932703fc41d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.055930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a9fcea26b9441986bfc932703fc41d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:40.057894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:40.116200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a9fcea26b9441986bfc932703fc41d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.116903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a9fcea26b9441986bfc932703fc41d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.117578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a9fcea26b9441986bfc932703fc41d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.126194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a9fcea26b9441986bfc932703fc41d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.139858 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e1423a00-4dd9-4b27-818e-6c9fcfc3da47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a9fcea26b9441986bfc932703fc41d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.153812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1251/2495] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:39 2022] DELETE /identity/v3/users/f3a9fcea26b9441986bfc932703fc41d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:40.440101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:40.441812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:40.455183 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260886-6453-4784-acc9-ebe727487f56 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:40.513539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:40.514427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.514706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.514981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] PATH_INFO: `/v3/projects/f2d02bef8d054213b46b175de1deffcc` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.516225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d02bef8d054213b46b175de1deffcc)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:40.518232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:40.553547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:40.572276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d02bef8d054213b46b175de1deffcc', 'request_id': 'req-a3a4b4ca-af22-4042-85a4-01575faea0ee'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.582544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d02bef8d054213b46b175de1deffcc', 'request_id': 'req-a3a4b4ca-af22-4042-85a4-01575faea0ee'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.590202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d02bef8d054213b46b175de1deffcc', 'request_id': 'req-a3a4b4ca-af22-4042-85a4-01575faea0ee'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.602312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] The token cache is being invalidate because project f2d02bef8d054213b46b175de1deffcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:40.602581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.603372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a3a4b4ca-af22-4042-85a4-01575faea0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:40.605007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1245/2496] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:40 2022] DELETE /identity/v3/projects/f2d02bef8d054213b46b175de1deffcc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:40.610097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.610871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.610871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.634566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:40.636011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:40.712319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1252/2497] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:40.720668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.720964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.721289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.742670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:40.743917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:40.752370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1246/2498] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:40.756849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:40.767204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e341-644a-4f0e-bf1a-14baf86f8d8e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:40.772383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:40.773198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.773476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.773717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.774842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:21:40.775230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:40.777200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:40.791419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1253/2499] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:21:40.796036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:40.806218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfcb1f-3577-4483-a337-c9b8934577ab None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:40.811231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:40.811904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.812186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.812462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.813235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:40.815356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:40.845069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1247/2500] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:40.849549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:40.859835 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6abd0-7d77-4884-bfaa-995e2a5dd612 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:40.887399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:40.919658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:40.920339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.920621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.920893 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.921633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:40.923555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:40.947474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1254/2501] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:40 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:40.951812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:40.967613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bca19f-5f89-4278-9980-5234a53bf0a8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:40.974815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:40.975502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:40.975795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:40.976056 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:40.976864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:40.978553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:40.991415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1248/2502] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:40.995776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.006726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f29b4-0146-45cd-a8db-35b68b8d0fd5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.012064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184ab03-a00f-4f80-92e0-bfa43cd1c5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.012747 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ab03-a00f-4f80-92e0-bfa43cd1c5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.013055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ab03-a00f-4f80-92e0-bfa43cd1c5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.013330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ab03-a00f-4f80-92e0-bfa43cd1c5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.014069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184ab03-a00f-4f80-92e0-bfa43cd1c5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.015682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184ab03-a00f-4f80-92e0-bfa43cd1c5d5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.028559 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1255/2503] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:41.033146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.045051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1785eb-8e5f-40ce-92f6-9c7349b0c8f6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.051764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.052831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.053139 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.053401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] PATH_INFO: `/v3/projects/8dd1dbb7c22847048a070a74d84ea990/users/10e545aaccfb462499a8a41fb6c9312b/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.070561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd1dbb7c22847048a070a74d84ea990, user_id=10e545aaccfb462499a8a41fb6c9312b, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.073296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.088117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1249/2504] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:41 2022] PUT /identity/v3/projects/8dd1dbb7c22847048a070a74d84ea990/users/10e545aaccfb462499a8a41fb6c9312b/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:41.098863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.099086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.099370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.131985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] MFA Rules not processed for user `10e545aaccfb462499a8a41fb6c9312b`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:41.133271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:41.202125 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1256/2505] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:41.206849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.277606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26db45-dc68-4fed-a2a2-3ca14d8acd4e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.282600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.283331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.283603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.283913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.284627 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.286869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.314782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1250/2506] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:41 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:41.319087 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.332970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902679a-a448-4310-809c-c0ed48c282e9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.403635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.404678 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.405167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.405597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.406745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.409604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.432362 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1257/2507] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:41 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:41.436490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.447086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4c21-8d8c-4c2e-ad69-e61875841db1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.452159 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.452824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.453131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.453399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.454136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.455740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.466563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1251/2508] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:41.470880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.482300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a6e84-f90e-461e-abbc-bf9fe8116b7e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.487330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.488535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.488535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.488759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] PATH_INFO: `/v3/projects/1a20897ec8284d36b18d4bd70b484347/users/97199c96ab274fa0bb6d7b58426711d4/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.506329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a20897ec8284d36b18d4bd70b484347, user_id=97199c96ab274fa0bb6d7b58426711d4, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.509006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.524404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1258/2509] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:41 2022] PUT /identity/v3/projects/1a20897ec8284d36b18d4bd70b484347/users/97199c96ab274fa0bb6d7b58426711d4/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:41.528807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.540102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7df9e-0c06-4a4c-a4c2-2f620b22c5ed admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.562730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:41.604703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffede28-f979-4142-a7b0-9575e0e94dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.605427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffede28-f979-4142-a7b0-9575e0e94dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.605710 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffede28-f979-4142-a7b0-9575e0e94dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.605987 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffede28-f979-4142-a7b0-9575e0e94dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.606730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffede28-f979-4142-a7b0-9575e0e94dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.608363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffede28-f979-4142-a7b0-9575e0e94dc3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.623492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1252/2510] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:41.629161 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.635160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:41.641861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f6a3f-3e19-4e69-a747-52dea6b29764 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.647400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.648352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.648640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.648923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] PATH_INFO: `/v3/projects/1a20897ec8284d36b18d4bd70b484347/users/97199c96ab274fa0bb6d7b58426711d4/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.651038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a20897ec8284d36b18d4bd70b484347, user_id=97199c96ab274fa0bb6d7b58426711d4, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.653827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.665680 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1259/2511] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:41 2022] PUT /identity/v3/projects/1a20897ec8284d36b18d4bd70b484347/users/97199c96ab274fa0bb6d7b58426711d4/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:41.677659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.677911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.678205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.707501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] MFA Rules not processed for user `97199c96ab274fa0bb6d7b58426711d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:41.708927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:41.793143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1253/2512] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:41.810070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:41.812605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:41.881851 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd326-828f-4eae-a053-0e7d8407375d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:41.886763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e969db-ca86-4543-bee5-6c30dd65ec3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:41.887703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e969db-ca86-4543-bee5-6c30dd65ec3b service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:41.888051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e969db-ca86-4543-bee5-6c30dd65ec3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:41.888370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e969db-ca86-4543-bee5-6c30dd65ec3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:41.898716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e969db-ca86-4543-bee5-6c30dd65ec3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:41.900228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e969db-ca86-4543-bee5-6c30dd65ec3b service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:41.912810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1260/2513] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:41.942007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:42.021744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e85c-1944-4b43-b69c-d5390686975d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:42.026558 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:42.027439 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:42.027721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:42.027998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] PATH_INFO: `/v3/users/10e545aaccfb462499a8a41fb6c9312b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:42.029292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e545aaccfb462499a8a41fb6c9312b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:42.031246 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:42.090172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e545aaccfb462499a8a41fb6c9312b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.090849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e545aaccfb462499a8a41fb6c9312b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.091473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e545aaccfb462499a8a41fb6c9312b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.092874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:42.102640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e545aaccfb462499a8a41fb6c9312b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.116399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e545aaccfb462499a8a41fb6c9312b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.132432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1254/2514] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:41 2022] DELETE /identity/v3/users/10e545aaccfb462499a8a41fb6c9312b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:42.137570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:42.137880 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:42.138180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:42.157267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:42.158474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:42.224749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1261/2515] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:42.234616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:42.236092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:42.300872 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0149-6f93-4ae6-9ad8-3d4f4b3c4e70 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:42.305078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:42.306086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:42.306235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:42.306548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:42.317411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:42.318870 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:42.329902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1255/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:42.636406 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:42.639182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:42.654328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdd22-e4da-4eec-bedb-51de4bfcd1da None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:42.662545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:42.663898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:42.664399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:42.664842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] PATH_INFO: `/v3/projects/8dd1dbb7c22847048a070a74d84ea990` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:42.666682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd1dbb7c22847048a070a74d84ea990)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:42.670054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:42.726344 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd1dbb7c22847048a070a74d84ea990', 'request_id': 'req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.735243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd1dbb7c22847048a070a74d84ea990', 'request_id': 'req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.741463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd1dbb7c22847048a070a74d84ea990', 'request_id': 'req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.754872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] The token cache is being invalidate because project 8dd1dbb7c22847048a070a74d84ea990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:42.755158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.755898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.757628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1262/2517] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:42 2022] DELETE /identity/v3/projects/8dd1dbb7c22847048a070a74d84ea990 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:42.762062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:42.774664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf07efa-131d-47e4-9600-e1f579491995 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:42.837162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:42.838053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:42.838340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:42.838623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] PATH_INFO: `/v3/users/97199c96ab274fa0bb6d7b58426711d4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:42.839856 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97199c96ab274fa0bb6d7b58426711d4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:42.841839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:42.895692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97199c96ab274fa0bb6d7b58426711d4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.896347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97199c96ab274fa0bb6d7b58426711d4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.896948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97199c96ab274fa0bb6d7b58426711d4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.904373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97199c96ab274fa0bb6d7b58426711d4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.915614 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:42.918291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b517c674-fb2e-4175-8d61-c1c6ab2a1a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97199c96ab274fa0bb6d7b58426711d4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:42.934157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1256/2518] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:42 2022] DELETE /identity/v3/users/97199c96ab274fa0bb6d7b58426711d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:43.217138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.218695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:43.234337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6dfd1-bfdf-4fdb-9ab5-a13436c5f2cd admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.249879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:43.309966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.311202 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.311675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.312132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] PATH_INFO: `/v3/projects/1a20897ec8284d36b18d4bd70b484347` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.314348 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a20897ec8284d36b18d4bd70b484347)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.317408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.383110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a20897ec8284d36b18d4bd70b484347', 'request_id': 'req-a054351b-6061-4bec-ac13-1b6d6a9ffc57'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:43.390401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a20897ec8284d36b18d4bd70b484347', 'request_id': 'req-a054351b-6061-4bec-ac13-1b6d6a9ffc57'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:43.396214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a20897ec8284d36b18d4bd70b484347', 'request_id': 'req-a054351b-6061-4bec-ac13-1b6d6a9ffc57'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:43.408758 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] The token cache is being invalidate because project 1a20897ec8284d36b18d4bd70b484347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:43.409058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:43.409765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-a054351b-6061-4bec-ac13-1b6d6a9ffc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:43.411821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1263/2519] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:43 2022] DELETE /identity/v3/projects/1a20897ec8284d36b18d4bd70b484347 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:21:43.416844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.417166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.417531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.437182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:43.438422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:43.502002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1257/2520] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:21:43.510486 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.510773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.511053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.532571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:43.533842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:43.544381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1264/2521] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:43.548860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.559813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212c97-b79b-4da2-8dae-2cd84a616589 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.564932 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.565591 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.565873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.566146 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.567007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:21:43.567317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.568963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.581585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1258/2522] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:21:43.586241 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.595832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8be79-81e6-404b-a9c7-e07023098c76 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.601760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.602427 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.602752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.603025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.603735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.605695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.635902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1265/2523] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:43 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:43.640472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.651059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c394-4d66-425b-987b-444538fd6679 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.715010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.715702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.715986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.716262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.717076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.719024 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.742286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1259/2524] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:43 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:43.747084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.760706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ad73d-2cb2-4e9d-b23a-56b27172240c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.766292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.766972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.767255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.767532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.768270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.770008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.781194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1266/2525] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:43.785900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.799330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc3b63-1ff5-4b68-958b-13483ccd3551 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.807216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494c98e-2b7d-4094-a76e-2ae06e803988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.808280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c98e-2b7d-4094-a76e-2ae06e803988 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.808738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c98e-2b7d-4094-a76e-2ae06e803988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.809251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c98e-2b7d-4094-a76e-2ae06e803988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.810430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494c98e-2b7d-4094-a76e-2ae06e803988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.812944 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494c98e-2b7d-4094-a76e-2ae06e803988 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.825343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1260/2526] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:43.830283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:43.841924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b315-8d1b-40f3-9887-83b744b3183c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:43.848105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:43.849538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.849823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.850103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] PATH_INFO: `/v3/projects/62dc03c466894ab79f8960193f9d6184/users/6ddaf154da244e309c30a3393f7849a0/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.868916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dc03c466894ab79f8960193f9d6184, user_id=6ddaf154da244e309c30a3393f7849a0, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:43.871605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:43.890038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1267/2527] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:43 2022] PUT /identity/v3/projects/62dc03c466894ab79f8960193f9d6184/users/6ddaf154da244e309c30a3393f7849a0/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:43.901319 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:43.901605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:43.901891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:43.933681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] MFA Rules not processed for user `6ddaf154da244e309c30a3393f7849a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:43.934938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:43.990590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:44.017978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1261/2528] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:44.023147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.071788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:44.091472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849e467-96f9-455a-9309-3e88b9115b14 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.096589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.097302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.097571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.097857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.098685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.100529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.129215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1268/2529] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:44 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:44.133577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.145450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd052f-dac6-4793-aafe-73805e158315 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.206990 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.207921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.208168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.208434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.209191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.211145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.234765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1262/2530] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:44 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:44.239140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.250715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a8b5b-8a63-44a0-a445-039263f97710 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.256035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.256698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.256977 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.257276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.258007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.259773 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.272136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1269/2531] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:44.276510 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.287531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5fd3-a54f-40e8-9cef-0fe868488a1b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.292552 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.293490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.293763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.294037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] PATH_INFO: `/v3/projects/11e5b859c2e14eaa953deee25fc3eca0/users/0e04e849f6814c17914adaceda080d9f/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.310752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e5b859c2e14eaa953deee25fc3eca0, user_id=0e04e849f6814c17914adaceda080d9f, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.313526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.328831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1263/2532] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:44 2022] PUT /identity/v3/projects/11e5b859c2e14eaa953deee25fc3eca0/users/0e04e849f6814c17914adaceda080d9f/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:44.333296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.344812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b834d-458c-49ca-b5f4-1d983dfb4267 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.412635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d68c09-d3d4-49dd-b4f1-45e991567b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.413390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d68c09-d3d4-49dd-b4f1-45e991567b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.413675 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d68c09-d3d4-49dd-b4f1-45e991567b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.413951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d68c09-d3d4-49dd-b4f1-45e991567b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.414710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d68c09-d3d4-49dd-b4f1-45e991567b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.416352 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d68c09-d3d4-49dd-b4f1-45e991567b61 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.430840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1270/2533] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:44.434261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.445632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b11122-fb31-4df4-9f6a-3c14502d4733 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.451033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.451977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.452264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.452579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] PATH_INFO: `/v3/projects/11e5b859c2e14eaa953deee25fc3eca0/users/0e04e849f6814c17914adaceda080d9f/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.454666 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e5b859c2e14eaa953deee25fc3eca0, user_id=0e04e849f6814c17914adaceda080d9f, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.457404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.471482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1264/2534] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:44 2022] PUT /identity/v3/projects/11e5b859c2e14eaa953deee25fc3eca0/users/0e04e849f6814c17914adaceda080d9f/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:44.483303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.483597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.483870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.518877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] MFA Rules not processed for user `0e04e849f6814c17914adaceda080d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:44.520374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:44.594303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1271/2535] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:44.605417 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:44.607171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:44.676620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33447c-da20-4c12-94cd-314367f45136 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:44.680706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532fe1b-8cea-479e-99b0-2850bccfa6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:44.681395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532fe1b-8cea-479e-99b0-2850bccfa6dc service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:44.681679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532fe1b-8cea-479e-99b0-2850bccfa6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:44.681938 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532fe1b-8cea-479e-99b0-2850bccfa6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:44.692045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532fe1b-8cea-479e-99b0-2850bccfa6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:44.693537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532fe1b-8cea-479e-99b0-2850bccfa6dc service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:44.703359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1265/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:45.369598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:45.424534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:45.453213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367a4c0-103c-4968-bf1e-5f42b5e81344 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:45.459557 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:45.460487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:45.460749 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:45.461041 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] PATH_INFO: `/v3/users/6ddaf154da244e309c30a3393f7849a0` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:45.462295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddaf154da244e309c30a3393f7849a0)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:45.464257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:45.527789 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddaf154da244e309c30a3393f7849a0'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:45.528545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddaf154da244e309c30a3393f7849a0'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:45.529284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddaf154da244e309c30a3393f7849a0'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:45.538499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddaf154da244e309c30a3393f7849a0'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:45.553652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddaf154da244e309c30a3393f7849a0'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:45.571924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1272/2537] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:45 2022] DELETE /identity/v3/users/6ddaf154da244e309c30a3393f7849a0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:45.576831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:45.577474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:45.577474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:45.601203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:45.603301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:45.646432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:45.684719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1266/2538] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:21:45.695762 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:45.698330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:45.773780 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546713ea-74e5-42ad-9575-3eb8ab4f90a0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:45.777878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:45.778577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:45.778860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:45.779118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:45.789699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:45.791391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:45.802378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1273/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:46.092090 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:46.093985 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:46.111640 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e676f-4071-4c0c-b129-2fdc364924d5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:46.117950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:46.118910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:46.119154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:46.119430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] PATH_INFO: `/v3/projects/62dc03c466894ab79f8960193f9d6184` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:46.121175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dc03c466894ab79f8960193f9d6184)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:46.123308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:46.172846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dc03c466894ab79f8960193f9d6184', 'request_id': 'req-284f1f24-ce48-41bd-bba9-b67efaf09460'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.181943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dc03c466894ab79f8960193f9d6184', 'request_id': 'req-284f1f24-ce48-41bd-bba9-b67efaf09460'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.188521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dc03c466894ab79f8960193f9d6184', 'request_id': 'req-284f1f24-ce48-41bd-bba9-b67efaf09460'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.200605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] The token cache is being invalidate because project 62dc03c466894ab79f8960193f9d6184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:46.201007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.201530 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.203229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1267/2540] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:46 2022] DELETE /identity/v3/projects/62dc03c466894ab79f8960193f9d6184 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:46.207331 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:46.217375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317425f-568e-47fb-9fc9-95cd92f2d6e9 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:46.278650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:46.279548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:46.279827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:46.280104 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] PATH_INFO: `/v3/users/0e04e849f6814c17914adaceda080d9f` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:46.281424 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e04e849f6814c17914adaceda080d9f)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:46.283405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:46.285266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:46.345434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e04e849f6814c17914adaceda080d9f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.346413 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e04e849f6814c17914adaceda080d9f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.347423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e04e849f6814c17914adaceda080d9f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.357588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e04e849f6814c17914adaceda080d9f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.372329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e2d38723-9f41-4bb7-b354-ec6c23de7520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e04e849f6814c17914adaceda080d9f'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.388256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1274/2541] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:46 2022] DELETE /identity/v3/users/0e04e849f6814c17914adaceda080d9f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:46.692773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:46.694356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:46.708802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f1f24-ce48-41bd-bba9-b67efaf09460 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:46.771355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:46.772169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:46.772446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:46.772718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] PATH_INFO: `/v3/projects/11e5b859c2e14eaa953deee25fc3eca0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:46.774093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e5b859c2e14eaa953deee25fc3eca0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:46.776044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:46.835562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e5b859c2e14eaa953deee25fc3eca0', 'request_id': 'req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.843137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e5b859c2e14eaa953deee25fc3eca0', 'request_id': 'req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.847996 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:46.849429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e5b859c2e14eaa953deee25fc3eca0', 'request_id': 'req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.862315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] The token cache is being invalidate because project 11e5b859c2e14eaa953deee25fc3eca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:46.862603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.863315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9eec78c5-ed3f-4d70-809a-c4a9f7defc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:46.865185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1268/2542] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:46 2022] DELETE /identity/v3/projects/11e5b859c2e14eaa953deee25fc3eca0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:46.870670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:46.870959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:46.871243 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:46.890950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:46.892187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:46.955903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1275/2543] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:46.964349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:46.964636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:46.964914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:46.984517 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:46.985777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:46.994567 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1269/2544] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:46.999112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.009297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665511e-0d0d-4881-8c57-2a685103975f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.016392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.017068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.017377 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.017649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.018395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:21:47.018701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.020613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.033327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1276/2545] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:21:47.037842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.048422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ece0a-8b07-42c4-a1ae-0a88e2c42af5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.054110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.054788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.055066 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.055335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.056036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.057963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.090169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1270/2546] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:47 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:47.091521 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.102118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9979739-b77d-4a39-aea4-fba5d73ce1d3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.159703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.160477 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.160877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.161002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.161763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.163706 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.173602 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:47.191268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1277/2547] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:47 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:47.192966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.203952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613250-fb0d-4d00-b8c8-75042db35560 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.209638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.210355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.210637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.210916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.211664 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.213304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.224902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1271/2548] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:21:47.229766 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.241573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3cb8-3c57-4086-8c2c-b8d9606fd627 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.246898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f18469-8e9d-42d2-b1e8-932ab423f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.247578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f18469-8e9d-42d2-b1e8-932ab423f73e admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.247859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f18469-8e9d-42d2-b1e8-932ab423f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.248134 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f18469-8e9d-42d2-b1e8-932ab423f73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.248872 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f18469-8e9d-42d2-b1e8-932ab423f73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.250519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f18469-8e9d-42d2-b1e8-932ab423f73e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.261909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1278/2549] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:47.266538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.278661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1042-a274-46da-9258-614cebe43093 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.285916 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.287318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.287778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.288231 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] PATH_INFO: `/v3/projects/7997764dedf64ae882fb851a4ca271aa/users/4fe67db257e046438c9f5a96a4be4d7d/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.309859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7997764dedf64ae882fb851a4ca271aa, user_id=4fe67db257e046438c9f5a96a4be4d7d, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.312344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.326563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1272/2550] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:47 2022] PUT /identity/v3/projects/7997764dedf64ae882fb851a4ca271aa/users/4fe67db257e046438c9f5a96a4be4d7d/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:21:47.337665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.337950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.338225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.368448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] MFA Rules not processed for user `4fe67db257e046438c9f5a96a4be4d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:47.369691 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:47.443620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1279/2551] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:47.448550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.530209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d4b19-80a7-4d53-b4c5-061d54de1b15 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.535180 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.535858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.536194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.536412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.537165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.539076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.568282 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1273/2552] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:47 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:47.572575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.583723 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1f715-6568-4b86-a940-091b16fe4c7d None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.641268 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.641955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.642255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.642510 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.643189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.645220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.668989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1280/2553] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:47 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:47.673124 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.684185 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04196ad-02b3-4da0-9615-09809b9f5111 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.689785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.690452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.690734 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.691008 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.691846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.693493 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.704297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1274/2554] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:47.709417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.724606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff84c-8fe2-4905-9903-363e4ea1d5a3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.730314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.731201 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.731483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.731763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] PATH_INFO: `/v3/projects/8f95b3fe35a14281b2ba4cfab6cee85e/users/3777ad70d1c14ff18ad3f0b78df9fbef/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.748296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f95b3fe35a14281b2ba4cfab6cee85e, user_id=3777ad70d1c14ff18ad3f0b78df9fbef, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.751015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.767127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1281/2555] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:47 2022] PUT /identity/v3/projects/8f95b3fe35a14281b2ba4cfab6cee85e/users/3777ad70d1c14ff18ad3f0b78df9fbef/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:47.771261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.781744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f132ede-b01e-4ad9-92df-762e1076815b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.843125 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c8fd2-3fdf-4f9a-98c1-e4ed51100ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.843718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c8fd2-3fdf-4f9a-98c1-e4ed51100ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.844005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c8fd2-3fdf-4f9a-98c1-e4ed51100ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.844279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c8fd2-3fdf-4f9a-98c1-e4ed51100ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.845042 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c8fd2-3fdf-4f9a-98c1-e4ed51100ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.846659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c8fd2-3fdf-4f9a-98c1-e4ed51100ffe admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.849307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:47.860136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1275/2556] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:21:47.863810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:47.875404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a658f-a537-47cc-87ec-1b9d9ec0b16c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:47.880730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:47.881652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.881929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.882203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] PATH_INFO: `/v3/projects/8f95b3fe35a14281b2ba4cfab6cee85e/users/3777ad70d1c14ff18ad3f0b78df9fbef/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.884398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f95b3fe35a14281b2ba4cfab6cee85e, user_id=3777ad70d1c14ff18ad3f0b78df9fbef, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:47.887215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:47.898604 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1282/2557] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:47 2022] PUT /identity/v3/projects/8f95b3fe35a14281b2ba4cfab6cee85e/users/3777ad70d1c14ff18ad3f0b78df9fbef/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:47.910348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:47.910650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:47.910943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:47.945437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] MFA Rules not processed for user `3777ad70d1c14ff18ad3f0b78df9fbef`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:47.946721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:48.025667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1276/2558] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:48.038463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:48.040249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:48.072131 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:48.106807 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fd5a2-e229-47f4-b1cc-1a3c3bffb171 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:48.110803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caba31-24e8-4cc1-bca6-c7835a444d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:48.111490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caba31-24e8-4cc1-bca6-c7835a444d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:48.111769 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caba31-24e8-4cc1-bca6-c7835a444d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:48.112076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caba31-24e8-4cc1-bca6-c7835a444d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:48.170076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caba31-24e8-4cc1-bca6-c7835a444d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:48.171532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caba31-24e8-4cc1-bca6-c7835a444d9a service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:48.180830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1283/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:50.756184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:50.821562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd79f0-4bba-4967-94b4-28f83da69107 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:50.826693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:50.827563 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:50.827838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:50.828118 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] PATH_INFO: `/v3/users/4fe67db257e046438c9f5a96a4be4d7d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:50.829368 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe67db257e046438c9f5a96a4be4d7d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:50.831285 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:50.880850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe67db257e046438c9f5a96a4be4d7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:50.881451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe67db257e046438c9f5a96a4be4d7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:50.882078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe67db257e046438c9f5a96a4be4d7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:50.888912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe67db257e046438c9f5a96a4be4d7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:50.902130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe67db257e046438c9f5a96a4be4d7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:50.918210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1277/2560] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:50 2022] DELETE /identity/v3/users/4fe67db257e046438c9f5a96a4be4d7d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:50.922912 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:50.923419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:50.923540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:50.943894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:50.945152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:51.014563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1284/2561] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:21:51.025038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:51.026597 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:51.032272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:51.087590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2201bdc-8d91-4381-aa4b-5cdc3ecade44 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:51.091838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:51.092485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:51.092767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:51.093047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:51.103100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:51.104554 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:51.114720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1278/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:51.395188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:51.396651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:51.409768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604df29-6f47-4b9f-a52a-8b99863a16ed None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:51.415215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:51.416085 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:51.416363 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:51.416634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] PATH_INFO: `/v3/projects/7997764dedf64ae882fb851a4ca271aa` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:51.417889 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7997764dedf64ae882fb851a4ca271aa)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:51.419819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:51.470615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7997764dedf64ae882fb851a4ca271aa', 'request_id': 'req-c88efcac-88ad-4426-b4b8-c170ae44f8e1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.478432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7997764dedf64ae882fb851a4ca271aa', 'request_id': 'req-c88efcac-88ad-4426-b4b8-c170ae44f8e1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.484270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7997764dedf64ae882fb851a4ca271aa', 'request_id': 'req-c88efcac-88ad-4426-b4b8-c170ae44f8e1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.496130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] The token cache is being invalidate because project 7997764dedf64ae882fb851a4ca271aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:51.496401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.497103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.498997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1285/2563] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:51 2022] DELETE /identity/v3/projects/7997764dedf64ae882fb851a4ca271aa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:51.503143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:51.514658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83a8a-c596-478f-8d0e-e958497e0740 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:51.583025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:51.583914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:51.584189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:51.584467 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] PATH_INFO: `/v3/users/3777ad70d1c14ff18ad3f0b78df9fbef` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:51.585679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3777ad70d1c14ff18ad3f0b78df9fbef)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:51.587595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:51.637349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3777ad70d1c14ff18ad3f0b78df9fbef'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.638010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3777ad70d1c14ff18ad3f0b78df9fbef'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.638620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3777ad70d1c14ff18ad3f0b78df9fbef'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.646216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3777ad70d1c14ff18ad3f0b78df9fbef'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.659361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8a9209a7-a263-406a-8860-f521d514d30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3777ad70d1c14ff18ad3f0b78df9fbef'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:51.676715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1279/2564] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:21:51 2022] DELETE /identity/v3/users/3777ad70d1c14ff18ad3f0b78df9fbef => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:51.961730 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:51.963286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:51.973127 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:51.977387 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88efcac-88ad-4426-b4b8-c170ae44f8e1 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.041491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.042273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.042552 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.042804 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] PATH_INFO: `/v3/projects/8f95b3fe35a14281b2ba4cfab6cee85e` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.044099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f95b3fe35a14281b2ba4cfab6cee85e)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.046081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.100250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f95b3fe35a14281b2ba4cfab6cee85e', 'request_id': 'req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:52.108290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f95b3fe35a14281b2ba4cfab6cee85e', 'request_id': 'req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:52.114952 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f95b3fe35a14281b2ba4cfab6cee85e', 'request_id': 'req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:52.127796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] The token cache is being invalidate because project 8f95b3fe35a14281b2ba4cfab6cee85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:21:52.128116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:52.129062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-cc6fa0ca-4d88-426a-8c57-7b1cf35970f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:21:52.130726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1286/2565] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:21:51 2022] DELETE /identity/v3/projects/8f95b3fe35a14281b2ba4cfab6cee85e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:52.135833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.136372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.136372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.154669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:52.155890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:52.177039 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:52.224815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1280/2566] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:52.232888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.233217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.233497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.253528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:52.254803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:52.264420 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1287/2567] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:52.268934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.279328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365ea7d-cd82-46a1-9844-9022d50de90a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.284900 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.285936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.286088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.286301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.287059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:21:52.287335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.288961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.301958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1281/2568] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:21:52.306757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.317123 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c327652-9fcc-4329-b3a4-ddbca3aef007 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.323374 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.324036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.324318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.324584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.325314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.327220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.361740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1288/2569] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:21:52 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:52.366711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.376715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca7c8-7278-4cc4-b973-d90a998ae9d3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.436619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.437351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.437696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.437986 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.438705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.440661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.467822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1282/2570] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:21:52 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:21:52.469129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.480170 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5c38b-99b2-426c-8cf2-41b47dc6a36f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.485347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.486015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.486295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.486557 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.487304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.489433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.501035 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1289/2571] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:52.505387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.516775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b75247-8d0e-48b4-aba1-5f5599f64ee8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.522266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f6c7-20ec-4fc4-b6c4-8be0a3ed7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.522989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f6c7-20ec-4fc4-b6c4-8be0a3ed7eec admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.523263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f6c7-20ec-4fc4-b6c4-8be0a3ed7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.523661 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f6c7-20ec-4fc4-b6c4-8be0a3ed7eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.524406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f6c7-20ec-4fc4-b6c4-8be0a3ed7eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.526086 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f6c7-20ec-4fc4-b6c4-8be0a3ed7eec admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.537386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1283/2572] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:21:52.542039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.552683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f7a54-3ad4-4de0-8f39-e8885a6b7f63 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.557572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.558473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.558752 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.559020 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] PATH_INFO: `/v3/projects/dbeb18fed89a458e9ba2a998a73fe899/users/6ccfbda39c494fcfadded542666d3df3/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.575815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbeb18fed89a458e9ba2a998a73fe899, user_id=6ccfbda39c494fcfadded542666d3df3, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.579479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.599957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1290/2573] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:21:52 2022] PUT /identity/v3/projects/dbeb18fed89a458e9ba2a998a73fe899/users/6ccfbda39c494fcfadded542666d3df3/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:21:52.605254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc66b0-e76d-47e1-9dc1-451aa0826161 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.605812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc66b0-e76d-47e1-9dc1-451aa0826161 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.606286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc66b0-e76d-47e1-9dc1-451aa0826161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.627027 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c8fc66b0-e76d-47e1-9dc1-451aa0826161 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:52.628547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c8fc66b0-e76d-47e1-9dc1-451aa0826161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:52.687799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1284/2574] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:52.697844 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:52.699638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:52.736611 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:52.763642 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b495f8-4c7f-4780-9095-c1300fc64a47 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:52.767319 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:52.767982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:52.768262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:52.768532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:52.777998 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:52.779458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:52.789367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1291/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:53.485699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:53.486511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:53.486940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:53.516080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] MFA Rules not processed for user `6ccfbda39c494fcfadded542666d3df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:53.517578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:53.529768 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:53.539513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71eb5b-8bf9-4714-9f7e-187e2cc2d121 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:53.540103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:53.544776 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:53.545589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:53.545965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:53.546471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:53.548737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:53.603398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1285/2576] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:53.614842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:53.616647 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:53.639109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:53.640686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:53.652736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1292/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:21:53.690155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd06391-d032-4ff9-8a88-bbc924541f45 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:53.694232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e8995-5b35-4739-822c-35ddbcc15a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:53.694890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8995-5b35-4739-822c-35ddbcc15a60 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:53.695168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8995-5b35-4739-822c-35ddbcc15a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:53.695434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8995-5b35-4739-822c-35ddbcc15a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:53.704332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e8995-5b35-4739-822c-35ddbcc15a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:53.705817 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e8995-5b35-4739-822c-35ddbcc15a60 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:53.715000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1286/2578] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:21:54.858509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:54.860150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:54.872603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2158de-5987-46bb-a18c-c5bcbdfce3f9 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:54.876942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:54.877635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:54.877921 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:54.878194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:54.880240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:54.894443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:54.895902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:54.908911 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1293/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:21:55.115266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:55.116193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:55.116193 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:55.135164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] MFA Rules not processed for user `6ccfbda39c494fcfadded542666d3df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:21:55.136308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:55.144101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1287/2580] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:21:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:21:57.665401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:21:57.666984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:57.679355 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2fd0f-d34c-48ec-953a-2747a7ed6b03 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:21:57.683338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:21:57.684001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:21:57.684286 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:21:57.684565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:21:57.686662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:21:57.748279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:21:57.749748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:21:57.759225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1294/2581] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:21:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:01.136117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:01.146895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc621728-8322-4946-a061-a7ae50e85d14 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:01.151667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:01.152329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:01.152600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:01.152873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:01.155150 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:01.239942 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:01.241889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:01.266215 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1288/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:02.014918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:02.026042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b129de-6904-45c6-b4b1-b37f084f11a2 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:02.030054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:02.030871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:02.031186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:02.031460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:02.033438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:02.043904 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:02.045847 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:02.056083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1295/2583] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:03.638000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:03.647774 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b18c1-c981-4ad1-a797-d6577cb93bec service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:03.651721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:03.652372 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:03.652649 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:03.652899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:03.654778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:03.666887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:03.668311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:03.678333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1289/2584] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:07.135988 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:07.137716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:07.156708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e979b-f54a-41d5-880a-3ed0c3eb509d service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:07.161651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:07.162562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.162868 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.163166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] PATH_INFO: `/v3/users/8b341180925b454094d9bf5e6f5b3eaf` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.164336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b341180925b454094d9bf5e6f5b3eaf)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:07.166403 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:07.198356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:07.220301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b341180925b454094d9bf5e6f5b3eaf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.221159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b341180925b454094d9bf5e6f5b3eaf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.221867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b341180925b454094d9bf5e6f5b3eaf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.229481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b341180925b454094d9bf5e6f5b3eaf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.243168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-1c31db61-fa5d-4fb9-af99-46f7ace344eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b341180925b454094d9bf5e6f5b3eaf'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.262924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1296/2585] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:07 2022] DELETE /identity/v3/users/8b341180925b454094d9bf5e6f5b3eaf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:07.448277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:07.458933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc66b-cc7d-46e3-aca6-75d99dfaa2e7 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:07.470316 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:07.526762 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:07.527729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.528170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.528562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] PATH_INFO: `/v3/projects/6c6b89da4e96480ba68652cff770b388` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.530165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6b89da4e96480ba68652cff770b388)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:07.532196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:07.594149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6b89da4e96480ba68652cff770b388', 'request_id': 'req-e409b460-796b-4018-8d32-2b51a40edd7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.602972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6b89da4e96480ba68652cff770b388', 'request_id': 'req-e409b460-796b-4018-8d32-2b51a40edd7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.616018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6b89da4e96480ba68652cff770b388', 'request_id': 'req-e409b460-796b-4018-8d32-2b51a40edd7d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.628364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] The token cache is being invalidate because project 6c6b89da4e96480ba68652cff770b388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:07.628778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.629472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e409b460-796b-4018-8d32-2b51a40edd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:07.631154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1290/2586] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:07 2022] DELETE /identity/v3/projects/6c6b89da4e96480ba68652cff770b388 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:07.636451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.636936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.637338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.674105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:07.675435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:07.744991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1297/2587] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:07.753151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.753448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.753758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.773112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:07.774336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:07.782891 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1291/2588] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:07.787454 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:07.798584 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fc797-0a62-4857-909a-b76df237d18c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:07.804483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:07.805213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.805496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.805774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.806837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:22:07.807246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:07.808864 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:07.821578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1298/2589] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:22:07.826228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:07.835814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebd7a9-0802-48ff-b1cf-2862df15d454 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:07.843224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:07.843889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.844173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.844435 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.845173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:07.847117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:07.882685 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1292/2590] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:07 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:22:07.887001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:07.897469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec668-5d9e-45c3-8cc2-d5197cea3094 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:07.963413 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:07.964219 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:07.964506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:07.964784 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:07.965523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:07.967498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:07.994566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1299/2591] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:07 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:07.998853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:08.010460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af6dd9-e07c-4125-a28d-5c8aa4f002ea admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:08.015707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:08.016376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:08.016658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:08.016941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:08.017729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:08.019329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:08.030266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1293/2592] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:08.034405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:08.045000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19954ba6-bbef-47e8-8cdc-0f2ae8a627fd admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:08.049910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0d00a-8118-4226-b3f4-c2369d2a197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:08.050578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d00a-8118-4226-b3f4-c2369d2a197e admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:08.050856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d00a-8118-4226-b3f4-c2369d2a197e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:08.051132 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d00a-8118-4226-b3f4-c2369d2a197e admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:08.051920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0d00a-8118-4226-b3f4-c2369d2a197e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:08.053557 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0d00a-8118-4226-b3f4-c2369d2a197e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:08.064248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1300/2593] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:08.069158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:08.082222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3e167-c98c-4eff-9b1a-3c2805869971 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:08.090007 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:08.090948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:08.091228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:08.091504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] PATH_INFO: `/v3/projects/8a2b9c6be4fc4538a81bb09f4e43e5ca/users/ecb881e850fd405bb99bf5a2a43a3dea/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:08.108154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2b9c6be4fc4538a81bb09f4e43e5ca, user_id=ecb881e850fd405bb99bf5a2a43a3dea, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:08.110837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:08.127302 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1294/2594] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:08 2022] PUT /identity/v3/projects/8a2b9c6be4fc4538a81bb09f4e43e5ca/users/ecb881e850fd405bb99bf5a2a43a3dea/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:08.137757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f45e-8b79-406a-919d-8571a00e5668 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:08.138261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f45e-8b79-406a-919d-8571a00e5668 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:08.138261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f45e-8b79-406a-919d-8571a00e5668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:08.157110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:08.166878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6da2f45e-8b79-406a-919d-8571a00e5668 None None] MFA Rules not processed for user `ecb881e850fd405bb99bf5a2a43a3dea`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:08.168933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6da2f45e-8b79-406a-919d-8571a00e5668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:08.238369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1301/2595] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:08.250160 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:08.252102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:08.299555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:08.315420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8144c46-c573-446b-8adf-532a2ab3eb22 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:08.320249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:08.321882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:08.321882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:08.321882 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:08.331746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:08.333224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:08.342474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1295/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:08.825225 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:08.825664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:08.826036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:08.868734 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] MFA Rules not processed for user `43f9e7923ebb4939ac2bd590270b48d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:08.870199 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:08.943679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1302/2597] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:13.369155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:13.372778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:13.484704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68e9b-93db-404d-beca-0990fdec4261 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:13.492022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:13.493547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:13.494109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:13.494595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:13.497789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:13.513415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:13.515247 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85bb7c-1855-4d61-aadc-b4b4e2d7acec service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:13.529589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1296/2598] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:16.997537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:17.060860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19038a19-003d-4136-b0d7-c09d3775034e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:17.065967 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:17.066838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.067116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.067388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] PATH_INFO: `/v3/users/ecb881e850fd405bb99bf5a2a43a3dea` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.068605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb881e850fd405bb99bf5a2a43a3dea)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:17.070579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:17.123193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:17.124986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb881e850fd405bb99bf5a2a43a3dea'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.125740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb881e850fd405bb99bf5a2a43a3dea'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.126330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb881e850fd405bb99bf5a2a43a3dea'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.135806 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb881e850fd405bb99bf5a2a43a3dea'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.149595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb881e850fd405bb99bf5a2a43a3dea'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.165591 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1303/2599] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:16 2022] DELETE /identity/v3/users/ecb881e850fd405bb99bf5a2a43a3dea => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:17.170532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.171040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.171274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.189000 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:17.190248 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:17.262789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1297/2600] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:17.270029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:17.271614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:17.331811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955a51-8814-4ea7-a37f-5a5e97076052 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:17.336152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e807eb-b63d-4858-914e-b7384a9475fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:17.336795 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e807eb-b63d-4858-914e-b7384a9475fd service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.337106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e807eb-b63d-4858-914e-b7384a9475fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.337381 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e807eb-b63d-4858-914e-b7384a9475fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.347180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e807eb-b63d-4858-914e-b7384a9475fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:17.348622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e807eb-b63d-4858-914e-b7384a9475fd service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:17.358108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1304/2601] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:17.658767 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:17.660276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:17.672992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b1d30-bd82-47d3-a67f-83cbb94ad8b5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:17.677851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:17.678730 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.679010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.679283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] PATH_INFO: `/v3/projects/8a2b9c6be4fc4538a81bb09f4e43e5ca` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.680507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2b9c6be4fc4538a81bb09f4e43e5ca)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:17.682447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:17.732098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2b9c6be4fc4538a81bb09f4e43e5ca', 'request_id': 'req-66f7adb8-ef99-4751-8189-cd911ffb62b9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.742669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2b9c6be4fc4538a81bb09f4e43e5ca', 'request_id': 'req-66f7adb8-ef99-4751-8189-cd911ffb62b9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.749656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:17.751667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2b9c6be4fc4538a81bb09f4e43e5ca', 'request_id': 'req-66f7adb8-ef99-4751-8189-cd911ffb62b9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.767255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] The token cache is being invalidate because project 8a2b9c6be4fc4538a81bb09f4e43e5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:17.767539 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.768209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-66f7adb8-ef99-4751-8189-cd911ffb62b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:17.769841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1298/2602] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:17 2022] DELETE /identity/v3/projects/8a2b9c6be4fc4538a81bb09f4e43e5ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:17.774779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.775065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.775337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.793541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:17.794733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:17.856408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1305/2603] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:17.864545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.864833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.865176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.884555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:17.885788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:17.894731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1299/2604] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:17.899112 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:17.909314 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b4fb-676b-4871-a199-b2468e044d79 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:17.914194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:17.914854 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.915142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.915416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.916173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:22:17.916590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:17.918322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:17.930673 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1306/2605] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:22:17.935492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:17.944953 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365f846-ce90-47aa-81a9-a69651b1328b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:17.950414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:17.951198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:17.951478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:17.951722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:17.952451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:17.954422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:17.986141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1300/2606] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:17 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:17.987654 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:17.999505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff458564-6b04-4bee-b31d-b9498ef26762 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:18.052021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:18.064326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:18.065069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.065329 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.065622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.066327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:18.068271 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:18.093196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1307/2607] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:17 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:18.097394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:18.108382 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f5ca8-3805-4789-ae97-86010c3acf41 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:18.113141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:18.113809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.114152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.114427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.115162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:18.117177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:18.128238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1301/2608] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:18.133537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:18.147012 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d7be-f869-4794-9148-16e405167061 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:18.154003 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ac9b3-9373-4e38-a642-5bdd9224f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:18.154720 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac9b3-9373-4e38-a642-5bdd9224f431 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.155015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac9b3-9373-4e38-a642-5bdd9224f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.155326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac9b3-9373-4e38-a642-5bdd9224f431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.156200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ac9b3-9373-4e38-a642-5bdd9224f431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:18.157973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ac9b3-9373-4e38-a642-5bdd9224f431 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:18.170814 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1308/2609] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:18.175131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:18.186589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37e24e-e336-4e5b-887a-b6db0fd2d957 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:18.191822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:18.192744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.193040 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.193324 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] PATH_INFO: `/v3/projects/d70ccd8f292d4a24a558fd45fc203622/users/774fd3235cbd492a9c987284d668240d/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.209293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70ccd8f292d4a24a558fd45fc203622, user_id=774fd3235cbd492a9c987284d668240d, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:18.212013 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:18.231303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1302/2610] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:18 2022] PUT /identity/v3/projects/d70ccd8f292d4a24a558fd45fc203622/users/774fd3235cbd492a9c987284d668240d/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:22:18.242100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.242336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.242617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.272136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] MFA Rules not processed for user `774fd3235cbd492a9c987284d668240d`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:18.273433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:18.342249 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1309/2611] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:18.356255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:18.358504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:18.442871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f923-ffa4-4508-8ea7-315710913659 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:18.451802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ada0a-5261-424f-9adf-c2c6184e4123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:18.452464 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ada0a-5261-424f-9adf-c2c6184e4123 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.452743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ada0a-5261-424f-9adf-c2c6184e4123 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.453028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ada0a-5261-424f-9adf-c2c6184e4123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.461781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ada0a-5261-424f-9adf-c2c6184e4123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:18.463379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ada0a-5261-424f-9adf-c2c6184e4123 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:18.473342 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1303/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:18.694634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:18.769071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a72ad-8b71-4bbd-995c-fcf7b61fdef8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:18.776545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:18.777862 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.778144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.778417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] PATH_INFO: `/v3/users/774fd3235cbd492a9c987284d668240d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.780212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] RBAC: Authorizing `identity:delete_user(user_id=774fd3235cbd492a9c987284d668240d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:18.783382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:18.842287 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774fd3235cbd492a9c987284d668240d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:18.843088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774fd3235cbd492a9c987284d668240d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:18.843726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774fd3235cbd492a9c987284d668240d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:18.850869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774fd3235cbd492a9c987284d668240d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:18.856265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:18.866342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774fd3235cbd492a9c987284d668240d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:18.882401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1310/2613] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:18 2022] DELETE /identity/v3/users/774fd3235cbd492a9c987284d668240d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:18.888017 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:18.888650 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:18.888854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:18.911110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:18.912347 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:18.974948 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1304/2614] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:18.987031 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:18.988859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:19.052304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af165a2-9b2e-4e24-a839-c662c915776e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:19.056715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56bbb-e807-47ea-a933-9455eef5b99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:19.057405 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56bbb-e807-47ea-a933-9455eef5b99f service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.057685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56bbb-e807-47ea-a933-9455eef5b99f service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.057955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56bbb-e807-47ea-a933-9455eef5b99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.069279 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b56bbb-e807-47ea-a933-9455eef5b99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:19.070717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b56bbb-e807-47ea-a933-9455eef5b99f service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:19.083399 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1311/2615] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:19.467459 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:19.469003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:19.481541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14384d8-8c25-4415-9313-5a32591c2318 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:19.487747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:19.488719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.489143 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.489564 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] PATH_INFO: `/v3/projects/d70ccd8f292d4a24a558fd45fc203622` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.491427 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70ccd8f292d4a24a558fd45fc203622)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:19.493432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:19.503798 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:19.551161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70ccd8f292d4a24a558fd45fc203622', 'request_id': 'req-a52a2218-b781-4ccd-8249-ea506ae62b7c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:19.571445 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70ccd8f292d4a24a558fd45fc203622', 'request_id': 'req-a52a2218-b781-4ccd-8249-ea506ae62b7c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:19.585349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70ccd8f292d4a24a558fd45fc203622', 'request_id': 'req-a52a2218-b781-4ccd-8249-ea506ae62b7c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:19.601158 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] The token cache is being invalidate because project d70ccd8f292d4a24a558fd45fc203622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:19.601792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:19.602758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a52a2218-b781-4ccd-8249-ea506ae62b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:19.604757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1305/2616] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:19 2022] DELETE /identity/v3/projects/d70ccd8f292d4a24a558fd45fc203622 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:19.610052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.610315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.610605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.629179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:19.630390 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:19.695562 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1312/2617] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:19.705300 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.705585 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.705892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.726599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:19.728083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:19.742997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1306/2618] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:19.747708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:19.768857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a4d79-ac29-4310-813d-07adefe548a4 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:19.776873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:19.777995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.778865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.779172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.779914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:22:19.780223 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:19.782246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:19.796064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1313/2619] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:22:19.800937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:19.811941 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8f0e-634e-4eff-836d-be000a6279b4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:19.818245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:19.818923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.819208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.819484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.820194 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:19.822261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:19.855421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1307/2620] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:19 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:19.860309 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:19.871016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabab48-1a4f-4b0b-86ec-6d1bac954f97 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:19.932910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:19.933686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.933984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.934290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.936380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:19.938647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:19.956349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:19.962763 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1314/2621] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:19 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:19.967694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:19.983196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbf51-e834-4ed6-8a2a-78ce011ccea7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:19.988586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:19.989321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:19.989603 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:19.989903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:19.990955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:19.992608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.004332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1308/2622] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:20.008016 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.021109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053196-5e4f-41aa-a8f2-25627f2432da admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.027153 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56816889-2d04-46c6-82b3-8a051a5b9e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.028021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56816889-2d04-46c6-82b3-8a051a5b9e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.028236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56816889-2d04-46c6-82b3-8a051a5b9e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.028742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56816889-2d04-46c6-82b3-8a051a5b9e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.029586 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56816889-2d04-46c6-82b3-8a051a5b9e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.031465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56816889-2d04-46c6-82b3-8a051a5b9e6d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.046600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1315/2623] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:20.050801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.061251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4810fa-1054-4ae2-a664-7aa3dfd36013 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.066198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.067112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.067391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.067667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] PATH_INFO: `/v3/projects/f726a33283eb4b1db85c61fd1c422d62/users/ef5c05da5f444af098a733bd1e69eff7/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.082619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f726a33283eb4b1db85c61fd1c422d62, user_id=ef5c05da5f444af098a733bd1e69eff7, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.085257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.108149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1309/2624] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:20 2022] PUT /identity/v3/projects/f726a33283eb4b1db85c61fd1c422d62/users/ef5c05da5f444af098a733bd1e69eff7/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:20.112770 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.113269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.113371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.141960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] MFA Rules not processed for user `ef5c05da5f444af098a733bd1e69eff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:20.143266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:20.218622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1316/2625] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:20.223306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.304390 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eadd7-477c-4899-b5b5-e9175bcac317 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.310406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.311188 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.311499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.311758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.312485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.314431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.342144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1310/2626] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:20 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:20.346295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.357900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727192-1c25-40f8-ae14-7bb8cc7b49c7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.419583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.420302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.420587 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.420980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.421696 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.423683 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.445110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1317/2627] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:20 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:20.449261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.460701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0310-4299-4c82-9f4d-3540d0e9a8ea admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.466653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.467410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.467692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.468273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.468706 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.470423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.483157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1311/2628] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:20.487821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.503641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef4f0b-14c7-4e6f-b958-4983b0d1ea52 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.509629 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.510593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.510883 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.511159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] PATH_INFO: `/v3/projects/eb56c9c605f04cd7993f282fcf6773fd/users/eb269b75417e4ad9b1e5fe59544b3382/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.531888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb56c9c605f04cd7993f282fcf6773fd, user_id=eb269b75417e4ad9b1e5fe59544b3382, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.534707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.548699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1318/2629] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:20 2022] PUT /identity/v3/projects/eb56c9c605f04cd7993f282fcf6773fd/users/eb269b75417e4ad9b1e5fe59544b3382/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:20.552701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.563431 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63cdba-d016-4847-bbea-1d656f762b55 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.567170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:20.626154 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915d9c-3f80-44e7-870b-ef97461f4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.626849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915d9c-3f80-44e7-870b-ef97461f4c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.627133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915d9c-3f80-44e7-870b-ef97461f4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.627410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915d9c-3f80-44e7-870b-ef97461f4c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.628153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915d9c-3f80-44e7-870b-ef97461f4c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.629799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915d9c-3f80-44e7-870b-ef97461f4c6c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.641667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1312/2630] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:22:20.646238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.656994 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda362aa-cf68-496d-9e76-61209ef01a66 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.662000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.662888 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.663167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.663438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] PATH_INFO: `/v3/projects/eb56c9c605f04cd7993f282fcf6773fd/users/eb269b75417e4ad9b1e5fe59544b3382/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.665457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb56c9c605f04cd7993f282fcf6773fd, user_id=eb269b75417e4ad9b1e5fe59544b3382, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.668240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.679126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1319/2631] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:20 2022] PUT /identity/v3/projects/eb56c9c605f04cd7993f282fcf6773fd/users/eb269b75417e4ad9b1e5fe59544b3382/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:20.690537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.690912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.691120 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.721607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] MFA Rules not processed for user `eb269b75417e4ad9b1e5fe59544b3382`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:20.722828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:20.798933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1313/2632] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:20.811011 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:20.813155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:20.849984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:20.879781 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a521d-428e-4eb4-9494-f8d451ee7bad admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:20.884496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:20.885245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:20.885506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:20.885784 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:20.897622 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:20.899088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:20.909722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1320/2633] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:20.988454 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:21.000977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865aa08-e4ff-4a67-91af-50642084e25a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:21.010198 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:21.011067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:21.011432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:21.011795 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:21.082266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:21.083716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:21.093428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1314/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:30.905066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=12 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:31.088646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:32.595699 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:32.597280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:32.664515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bd7dd-2231-4864-b709-3714a9bfe3a4 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:32.671253 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:32.672204 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:32.672686 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:32.672965 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:32.675255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:32.748594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:32.750091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aeeaf-aff3-4b16-be22-f440952873b2 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:32.759852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1321/2635] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:34.142267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:34.207871 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c03e6-fdf9-4471-85e7-5a841f3e2b9d service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:34.212947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:34.213876 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:34.214276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:34.214593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] PATH_INFO: `/v3/users/ef5c05da5f444af098a733bd1e69eff7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:34.215903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5c05da5f444af098a733bd1e69eff7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:34.218051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:34.269419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5c05da5f444af098a733bd1e69eff7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:34.270389 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5c05da5f444af098a733bd1e69eff7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:34.271018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5c05da5f444af098a733bd1e69eff7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:34.278776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5c05da5f444af098a733bd1e69eff7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:34.295356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5c05da5f444af098a733bd1e69eff7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:34.309997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1315/2636] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:34 2022] DELETE /identity/v3/users/ef5c05da5f444af098a733bd1e69eff7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:34.314519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:34.314989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:34.315188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:34.332836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:34.334273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:34.411561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1322/2637] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:34.420747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:34.424450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:34.485972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6c8a-d306-480f-bd39-88783bef9062 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:34.489838 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:34.490951 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:34.491304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:34.491642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:34.501742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:34.503281 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:34.514340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1316/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:34.978277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:34.979840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:34.992861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adc01b-9b31-40c8-9ca7-42e26ce8e8a1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:34.997687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:34.998572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:34.998856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:34.999129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] PATH_INFO: `/v3/projects/f726a33283eb4b1db85c61fd1c422d62` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.000336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f726a33283eb4b1db85c61fd1c422d62)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:35.002525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:35.087439 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:35.090554 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f726a33283eb4b1db85c61fd1c422d62', 'request_id': 'req-fc7db98d-6a2d-4c1c-a292-366328bb85b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.100664 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f726a33283eb4b1db85c61fd1c422d62', 'request_id': 'req-fc7db98d-6a2d-4c1c-a292-366328bb85b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.107303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f726a33283eb4b1db85c61fd1c422d62', 'request_id': 'req-fc7db98d-6a2d-4c1c-a292-366328bb85b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.121184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] The token cache is being invalidate because project f726a33283eb4b1db85c61fd1c422d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:35.121498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.122217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.123918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1323/2639] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:34 2022] DELETE /identity/v3/projects/f726a33283eb4b1db85c61fd1c422d62 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:35.128241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:35.140309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b286293-235c-4a6b-9d26-b713df2cefd0 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:35.159652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:35.201130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:35.202026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:35.202304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:35.202577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] PATH_INFO: `/v3/users/eb269b75417e4ad9b1e5fe59544b3382` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.203800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb269b75417e4ad9b1e5fe59544b3382)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:35.205748 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:35.257751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb269b75417e4ad9b1e5fe59544b3382'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.258533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb269b75417e4ad9b1e5fe59544b3382'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.259209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb269b75417e4ad9b1e5fe59544b3382'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.266529 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb269b75417e4ad9b1e5fe59544b3382'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.279616 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a798c338-0a93-4c94-81b3-b260266e3e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb269b75417e4ad9b1e5fe59544b3382'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.296695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1317/2640] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:35 2022] DELETE /identity/v3/users/eb269b75417e4ad9b1e5fe59544b3382 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:35.588047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:35.590859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:35.605295 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db98d-6a2d-4c1c-a292-366328bb85b5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:35.666280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:35.667058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:35.667341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:35.667658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] PATH_INFO: `/v3/projects/eb56c9c605f04cd7993f282fcf6773fd` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.668841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb56c9c605f04cd7993f282fcf6773fd)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:35.670825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:35.720593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb56c9c605f04cd7993f282fcf6773fd', 'request_id': 'req-5201d811-c674-4dff-9fd2-1195c0c870c7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.728997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb56c9c605f04cd7993f282fcf6773fd', 'request_id': 'req-5201d811-c674-4dff-9fd2-1195c0c870c7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.734817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb56c9c605f04cd7993f282fcf6773fd', 'request_id': 'req-5201d811-c674-4dff-9fd2-1195c0c870c7'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.748113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] The token cache is being invalidate because project eb56c9c605f04cd7993f282fcf6773fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:35.748415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.749346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5201d811-c674-4dff-9fd2-1195c0c870c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:35.751322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1324/2641] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:35 2022] DELETE /identity/v3/projects/eb56c9c605f04cd7993f282fcf6773fd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:35.757371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:35.757756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:35.758123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.779989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:35.781251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:35.851577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1318/2642] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:35.864015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:35.864305 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:35.864606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.885336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:35.886475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:35.895954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1325/2643] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:35.900568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:35.911411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f08ac-e8d3-462e-ae6e-f1870be79ae7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:35.917089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:35.917788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:35.918068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:35.918340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.919082 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:22:35.919388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:35.921005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:35.934731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1319/2644] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:22:35.939422 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:35.950138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55e8a-93fb-4cfe-808d-1856a35f3493 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:35.957052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:35.958055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:35.958435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:35.958863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:35.959632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:35.962684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:35.994366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1326/2645] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:35 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:35.998805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.012542 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a88a3-5424-4943-9ab2-585f1c7b17a3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.045068 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:36.084929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.085641 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.085926 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.086203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.086915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.088846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.110388 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1320/2646] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:35 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:22:36.114859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.126828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31b0bb-e440-4c74-a435-c73713c9d71e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.132467 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.133194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.133476 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.133748 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.134740 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.136154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.151557 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1327/2647] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:36.156030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.166456 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03228e-8602-4270-8d77-5c7b57fdaba9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.171484 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003560-5f10-42f2-b7b0-e0ee368426d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.172151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003560-5f10-42f2-b7b0-e0ee368426d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.172436 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003560-5f10-42f2-b7b0-e0ee368426d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.172794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003560-5f10-42f2-b7b0-e0ee368426d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.173642 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f003560-5f10-42f2-b7b0-e0ee368426d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.175245 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f003560-5f10-42f2-b7b0-e0ee368426d9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.185237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1321/2648] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:22:36.190915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.201832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ca346-bae3-4333-8337-161a70977a53 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.207441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.208342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.208625 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.208901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] PATH_INFO: `/v3/projects/26794e175507462cbfc9a792eefe7110/users/c61471862957443cb5af40d0ddacab1d/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.225656 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=26794e175507462cbfc9a792eefe7110, user_id=c61471862957443cb5af40d0ddacab1d, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.228818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.240635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:36.246731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1328/2649] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:36 2022] PUT /identity/v3/projects/26794e175507462cbfc9a792eefe7110/users/c61471862957443cb5af40d0ddacab1d/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:36.257732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.258020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.258294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.284885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] MFA Rules not processed for user `c61471862957443cb5af40d0ddacab1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:36.286142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:36.357174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1322/2650] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:36.363200 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.434074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d7f08-bb89-4cfd-b0f7-f28d542eb0ba admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.439567 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.440230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.440518 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.440791 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.441593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.443532 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.473500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1329/2651] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:36 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:36.477681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.488562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ca8c-7f3c-4e95-afe3-6ae44a24777b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.547162 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.547929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.548301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.548579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.549309 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.551240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.572112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1323/2652] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:36 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:36.576022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.586877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4b9b-569a-4bb2-ba86-67b8b2bf306d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.591566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.592234 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.592519 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.592797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.593571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.595415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.606578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1330/2653] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:36.612002 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.622868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edc27-ee41-4069-a570-081f210fe2c0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.628714 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2493ac-8d8e-4aaa-85db-8f03ff0c1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.629414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2493ac-8d8e-4aaa-85db-8f03ff0c1d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.629655 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2493ac-8d8e-4aaa-85db-8f03ff0c1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.629963 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2493ac-8d8e-4aaa-85db-8f03ff0c1d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.630701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2493ac-8d8e-4aaa-85db-8f03ff0c1d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.632307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2493ac-8d8e-4aaa-85db-8f03ff0c1d27 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.643697 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1324/2654] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:36.648318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.662182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cebc0-390a-4c0d-bd23-b799b22b5463 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.668588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.669534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.669812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.670083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] PATH_INFO: `/v3/projects/9bf893371755473ebcbe93d15330eff0/users/7fbefe970dc74aceba302bf1b0493531/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.687369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf893371755473ebcbe93d15330eff0, user_id=7fbefe970dc74aceba302bf1b0493531, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.690244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.707294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1331/2655] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:36 2022] PUT /identity/v3/projects/9bf893371755473ebcbe93d15330eff0/users/7fbefe970dc74aceba302bf1b0493531/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:36.719005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.719297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.719691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.751341 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] MFA Rules not processed for user `7fbefe970dc74aceba302bf1b0493531`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:36.752572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:36.757350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:36.822822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1325/2656] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:36.828209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.901565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c230-e35a-448d-bb15-dfe82298b202 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:36.906739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:36.907930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:36.908217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:36.908494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:36.909230 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:36.911203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:36.940750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1332/2657] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:36 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:36.944845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:36.957385 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28376973-aa05-4a32-aa78-36f8eaab62fe None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:37.019851 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:37.020543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.020854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.021137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.021849 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:37.023789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:37.052015 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1326/2658] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:36 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:37.056481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:37.067801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9062fc-e015-4146-ad81-57bfc9f462ad admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:37.072825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:37.073597 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.073876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.074146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.074878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:37.076491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:37.089144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1333/2659] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:37.093410 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:37.107781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d68a-7296-4e0f-8f5f-54e87a1dfcb2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:37.115031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:37.116292 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.116577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.116854 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] PATH_INFO: `/v3/projects/cfd0bc633c96476e99d1aaf58535bf40/users/f724c7e519b646f8b2d13f7007b8f717/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.135084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd0bc633c96476e99d1aaf58535bf40, user_id=f724c7e519b646f8b2d13f7007b8f717, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:37.137805 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:37.154485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1327/2660] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:37 2022] PUT /identity/v3/projects/cfd0bc633c96476e99d1aaf58535bf40/users/f724c7e519b646f8b2d13f7007b8f717/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:22:37.158469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:37.169465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1eebc-ae27-4498-8368-15f93b63cd5f admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:37.194890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:37.236579 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609292-03d8-4f02-a6a1-0f7e012467e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:37.237315 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609292-03d8-4f02-a6a1-0f7e012467e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.237599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609292-03d8-4f02-a6a1-0f7e012467e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.237879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609292-03d8-4f02-a6a1-0f7e012467e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.238651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a609292-03d8-4f02-a6a1-0f7e012467e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:37.240631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a609292-03d8-4f02-a6a1-0f7e012467e6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:37.250861 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1334/2661] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:37.255486 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:37.271081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a051-0ed5-427e-8494-b4bee6528a92 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:37.277452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:37.278346 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.278624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.278892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] PATH_INFO: `/v3/projects/cfd0bc633c96476e99d1aaf58535bf40/users/f724c7e519b646f8b2d13f7007b8f717/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.281190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd0bc633c96476e99d1aaf58535bf40, user_id=f724c7e519b646f8b2d13f7007b8f717, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:37.283819 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:37.295669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1328/2662] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:37 2022] PUT /identity/v3/projects/cfd0bc633c96476e99d1aaf58535bf40/users/f724c7e519b646f8b2d13f7007b8f717/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:37.306110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218373c8-505b-4390-ac69-a190e3676886 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.306400 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218373c8-505b-4390-ac69-a190e3676886 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.306718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218373c8-505b-4390-ac69-a190e3676886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.339504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-218373c8-505b-4390-ac69-a190e3676886 None None] MFA Rules not processed for user `f724c7e519b646f8b2d13f7007b8f717`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:37.340735 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-218373c8-505b-4390-ac69-a190e3676886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:37.419535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1335/2663] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:37.433210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:37.435262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:37.497784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49ef2f-81a3-424d-9554-8f8fa1deb1a5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:37.502419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:37.503106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:37.503378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:37.503657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:37.513553 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:37.514995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:37.520412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:37.526512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1329/2664] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:38.057598 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218373c8-505b-4390-ac69-a190e3676886 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:38.059122 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-218373c8-505b-4390-ac69-a190e3676886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:38.071717 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218373c8-505b-4390-ac69-a190e3676886 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:38.075322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:38.075959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:38.076238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:38.076511 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:38.145421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:38.146878 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:38.158257 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1336/2665] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:43.290778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:43.300429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd428a-b93d-4a07-a46d-5434b828a489 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:43.304742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9ec3-40da-47f2-9e2c-23f61f3bc1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:43.305441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9ec3-40da-47f2-9e2c-23f61f3bc1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:43.305720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9ec3-40da-47f2-9e2c-23f61f3bc1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:43.306021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9ec3-40da-47f2-9e2c-23f61f3bc1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:43.372868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9ec3-40da-47f2-9e2c-23f61f3bc1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:43.374365 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9ec3-40da-47f2-9e2c-23f61f3bc1d6 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:43.383958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1330/2666] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:45.571178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:45.620550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:45.638856 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a8c40-b420-49d1-be3b-82bb202a7e84 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:45.644415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:45.645322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:45.645603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:45.645876 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] PATH_INFO: `/v3/users/c61471862957443cb5af40d0ddacab1d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:45.647077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61471862957443cb5af40d0ddacab1d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:45.648991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:45.697258 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61471862957443cb5af40d0ddacab1d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:45.697824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61471862957443cb5af40d0ddacab1d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:45.698430 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61471862957443cb5af40d0ddacab1d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:45.705570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61471862957443cb5af40d0ddacab1d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:45.719267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61471862957443cb5af40d0ddacab1d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:45.737949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1337/2667] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:45 2022] DELETE /identity/v3/users/c61471862957443cb5af40d0ddacab1d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:45.743903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:45.744391 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:45.744509 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:45.769407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:45.770625 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:45.845570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1331/2668] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:45.858244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:45.859972 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:45.924960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a07a-9a46-4b49-b885-fb3041e3acac admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:45.929347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:45.930026 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:45.930303 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:45.930599 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:45.941765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:45.943285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:45.953906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1338/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:46.245998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:46.247843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:46.260673 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226c46-849d-43fa-b7a6-6f7907ff609b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:46.266326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:46.267283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:46.267602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:46.267972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] PATH_INFO: `/v3/projects/26794e175507462cbfc9a792eefe7110` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:46.269255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26794e175507462cbfc9a792eefe7110)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:46.271197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:46.327487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26794e175507462cbfc9a792eefe7110', 'request_id': 'req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.338315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26794e175507462cbfc9a792eefe7110', 'request_id': 'req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.345686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26794e175507462cbfc9a792eefe7110', 'request_id': 'req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.359802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] The token cache is being invalidate because project 26794e175507462cbfc9a792eefe7110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:46.360137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.361085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.362923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1332/2670] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:46 2022] DELETE /identity/v3/projects/26794e175507462cbfc9a792eefe7110 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:46.368100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:46.380613 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839708f1-3d7c-4762-93c2-b818084c9554 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:46.442071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:46.442959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:46.443244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:46.443529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] PATH_INFO: `/v3/users/7fbefe970dc74aceba302bf1b0493531` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:46.444810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbefe970dc74aceba302bf1b0493531)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:46.446803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:46.453480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:46.503881 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbefe970dc74aceba302bf1b0493531'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.504453 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbefe970dc74aceba302bf1b0493531'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.505071 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbefe970dc74aceba302bf1b0493531'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.512239 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbefe970dc74aceba302bf1b0493531'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.527959 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbefe970dc74aceba302bf1b0493531'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:46.544192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1339/2671] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:46 2022] DELETE /identity/v3/users/7fbefe970dc74aceba302bf1b0493531 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:46.857531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:46.859033 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:46.877166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1fed9-695f-40ff-975e-e4fd8f42a98e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:46.899757 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:46.942057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:46.942923 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:46.943202 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:46.943474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] PATH_INFO: `/v3/projects/9bf893371755473ebcbe93d15330eff0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:46.944694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf893371755473ebcbe93d15330eff0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:46.946632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:46.998169 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf893371755473ebcbe93d15330eff0', 'request_id': 'req-f7308fc9-299a-43b1-b0e5-30eb094aaad4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.007217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf893371755473ebcbe93d15330eff0', 'request_id': 'req-f7308fc9-299a-43b1-b0e5-30eb094aaad4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.013259 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf893371755473ebcbe93d15330eff0', 'request_id': 'req-f7308fc9-299a-43b1-b0e5-30eb094aaad4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.025094 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] The token cache is being invalidate because project 9bf893371755473ebcbe93d15330eff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:47.025386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.026067 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.027746 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1333/2672] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:46 2022] DELETE /identity/v3/projects/9bf893371755473ebcbe93d15330eff0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:47.032078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:47.033929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:47.047267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc780e-b776-49fc-940d-cd1d9ed26c42 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:47.110356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:47.111891 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.112183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.112464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] PATH_INFO: `/v3/users/f724c7e519b646f8b2d13f7007b8f717` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.113760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f724c7e519b646f8b2d13f7007b8f717)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:47.116080 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:47.173154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f724c7e519b646f8b2d13f7007b8f717'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.174025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f724c7e519b646f8b2d13f7007b8f717'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.174718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f724c7e519b646f8b2d13f7007b8f717'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.181672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f724c7e519b646f8b2d13f7007b8f717'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.193980 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-781f3582-23d2-47c1-90b6-9b92831d7496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f724c7e519b646f8b2d13f7007b8f717'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.207924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1340/2673] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:22:47 2022] DELETE /identity/v3/users/f724c7e519b646f8b2d13f7007b8f717 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:22:47.500696 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:47.502289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:47.518182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7308fc9-299a-43b1-b0e5-30eb094aaad4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:47.588561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:47.589407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.589692 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.589967 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] PATH_INFO: `/v3/projects/cfd0bc633c96476e99d1aaf58535bf40` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.591177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd0bc633c96476e99d1aaf58535bf40)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:47.593133 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:47.647869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd0bc633c96476e99d1aaf58535bf40', 'request_id': 'req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.652184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:47.659286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd0bc633c96476e99d1aaf58535bf40', 'request_id': 'req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.666898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd0bc633c96476e99d1aaf58535bf40', 'request_id': 'req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.683515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] The token cache is being invalidate because project cfd0bc633c96476e99d1aaf58535bf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:22:47.683763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.684644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-77a24f6b-015c-4da3-b2bd-35c3c252f2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:22:47.686536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1334/2674] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:22:47 2022] DELETE /identity/v3/projects/cfd0bc633c96476e99d1aaf58535bf40 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:47.692943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.693267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.693545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.703095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:47.718500 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:47.720007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:47.787450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1341/2675] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:47.796914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.797237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.797522 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.817099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:47.818320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:47.827037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1335/2676] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:47.831784 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:47.842580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2dc5-c5bc-4484-b193-5d40f5b770a0 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:47.848248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:47.848919 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.849240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.849522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.850270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:22:47.850581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:47.852218 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:47.864570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1342/2677] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:22:47.869801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:47.879047 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caadb4-d54b-4329-bc99-0bb4b8084db2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:47.884249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:47.884917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.885270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.885551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.886289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:47.888240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:47.917478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1336/2678] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:47 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:47.921866 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:47.933462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb775-417d-4d52-8884-cf5eb68109c2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:47.996812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:47.997534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:47.997820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:47.998088 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:47.998823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.000767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.022096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1343/2679] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:47 2022] POST /identity/v3/users => generated 305 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:48.027590 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.039581 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739fa0-c425-4a68-bc21-ac76ef0697fb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.045452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.046122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.046409 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.046681 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.047419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.049163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.060210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1337/2680] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:48.064496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.076537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992fe50-c95e-49ba-977e-bbf910fd3b52 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.082668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9aa6c-f16c-4ceb-9b6d-d945ce9102d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.083342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9aa6c-f16c-4ceb-9b6d-d945ce9102d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.083628 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9aa6c-f16c-4ceb-9b6d-d945ce9102d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.083906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9aa6c-f16c-4ceb-9b6d-d945ce9102d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.084635 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9aa6c-f16c-4ceb-9b6d-d945ce9102d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.086274 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9aa6c-f16c-4ceb-9b6d-d945ce9102d9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.103282 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1344/2681] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:48.108123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.119151 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac76-2b68-4c79-9ffd-ad9d19a0272a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.124359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.125272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.125669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.125934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] PATH_INFO: `/v3/projects/201946b515ff4efa886f22e8a2e6046a/users/4c3e2830114e467b992b27e7c6c385f9/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.141111 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201946b515ff4efa886f22e8a2e6046a, user_id=4c3e2830114e467b992b27e7c6c385f9, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.144062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.160046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1338/2682] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:48 2022] PUT /identity/v3/projects/201946b515ff4efa886f22e8a2e6046a/users/4c3e2830114e467b992b27e7c6c385f9/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:48.172692 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.173005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.173423 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.204592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] MFA Rules not processed for user `4c3e2830114e467b992b27e7c6c385f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:48.206281 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:48.280531 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:48.288823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1345/2683] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:48.289927 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.362239 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1e6e-90b7-4506-9a1c-412ad1287764 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.368351 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.369061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.369364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.369638 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.370358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.372267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.402276 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1339/2684] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:22:48 2022] POST /identity/v3/projects => generated 407 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:22:48.406757 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.419444 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d7ad0-c2dc-44b4-92ba-1892ffcdbc5f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.481760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.482623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.483078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.483361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.484067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.486248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.511005 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1346/2685] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:22:48 2022] POST /identity/v3/users => generated 310 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:22:48.512802 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.524168 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325de27e-6d96-480a-8f1e-e3f533c9dee0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.529722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.530448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.530750 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.531038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.531784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.534117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.545607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1340/2686] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:48.549655 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.560275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc2e53-2174-4d2f-9b19-18b6df590ac2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.566808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.567951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.568278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.568627 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] PATH_INFO: `/v3/projects/7fd61e78317541e8b8f7b02010d9690a/users/efdb75073de24d5388e78b4a320dbfb6/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.586398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd61e78317541e8b8f7b02010d9690a, user_id=efdb75073de24d5388e78b4a320dbfb6, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.589098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.603044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1347/2687] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:48 2022] PUT /identity/v3/projects/7fd61e78317541e8b8f7b02010d9690a/users/efdb75073de24d5388e78b4a320dbfb6/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:22:48.609366 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.622561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111fe8-7d1b-4ecc-aac9-567fa49666af admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.674279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:48.686716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f39f05-d0e5-4a72-a59b-c12992772f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.687617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39f05-d0e5-4a72-a59b-c12992772f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.687952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39f05-d0e5-4a72-a59b-c12992772f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.688266 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39f05-d0e5-4a72-a59b-c12992772f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.689411 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f39f05-d0e5-4a72-a59b-c12992772f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.691173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f39f05-d0e5-4a72-a59b-c12992772f2c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.702171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1341/2688] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:22:48.706588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.717034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f5e8d-c5e7-4187-b209-96f3f27df3b3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.722450 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.723349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.723631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.723907 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] PATH_INFO: `/v3/projects/7fd61e78317541e8b8f7b02010d9690a/users/efdb75073de24d5388e78b4a320dbfb6/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.725885 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd61e78317541e8b8f7b02010d9690a, user_id=efdb75073de24d5388e78b4a320dbfb6, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.728540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.739133 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1348/2689] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:22:48 2022] PUT /identity/v3/projects/7fd61e78317541e8b8f7b02010d9690a/users/efdb75073de24d5388e78b4a320dbfb6/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:22:48.749992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.750279 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.750555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.778807 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] MFA Rules not processed for user `efdb75073de24d5388e78b4a320dbfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:22:48.780046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:48.851131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1342/2690] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:22:48.862534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:48.864502 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:22:48.923937 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a586c-c651-489e-b17d-4114d2df5be5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:48.928105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:48.928751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:48.929052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:48.929332 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:48.938957 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:48.940416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:48.950008 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1349/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:49.118478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:22:49.128759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32bbb9-a12a-451e-8966-052ce153290d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:22:49.133380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce77e46-f55a-4d46-9de3-f2f7c56fbefc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:22:49.134034 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77e46-f55a-4d46-9de3-f2f7c56fbefc service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:22:49.134313 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77e46-f55a-4d46-9de3-f2f7c56fbefc service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:22:49.134620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77e46-f55a-4d46-9de3-f2f7c56fbefc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:22:49.195098 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce77e46-f55a-4d46-9de3-f2f7c56fbefc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:22:49.196596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce77e46-f55a-4d46-9de3-f2f7c56fbefc service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:22:49.205887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1343/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:22:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:22:58.945855 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:59.201913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=67 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:02.829771 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:02.897083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f36c6-6cdd-4458-94f7-cb95d2fc5a9b service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:02.902120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:02.903073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:02.903360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:02.903679 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] PATH_INFO: `/v3/users/4c3e2830114e467b992b27e7c6c385f9` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:02.904954 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3e2830114e467b992b27e7c6c385f9)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:02.907037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:02.959470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3e2830114e467b992b27e7c6c385f9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:02.960151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3e2830114e467b992b27e7c6c385f9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:02.960753 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3e2830114e467b992b27e7c6c385f9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:02.967705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3e2830114e467b992b27e7c6c385f9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:02.980177 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3e2830114e467b992b27e7c6c385f9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:02.994890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1350/2693] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:23:02 2022] DELETE /identity/v3/users/4c3e2830114e467b992b27e7c6c385f9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:02.999812 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:03.000296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:03.000403 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:03.018378 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:03.019729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:03.087557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1344/2694] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:03.098120 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:03.099997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:03.170046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41072-0693-45f1-9f39-044c24ddcf89 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:03.174143 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:03.174808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:03.175095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:03.175475 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:03.185624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:03.187106 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:03.197799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1351/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:03.478657 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:03.480135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:03.494502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68892d01-ed8d-41bb-ab02-1eea188f0714 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:03.500079 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:03.501022 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:03.501290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:03.501613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] PATH_INFO: `/v3/projects/201946b515ff4efa886f22e8a2e6046a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:03.502933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201946b515ff4efa886f22e8a2e6046a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:03.505846 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:03.560568 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201946b515ff4efa886f22e8a2e6046a', 'request_id': 'req-20e00911-7b32-4618-8eef-dc2565c51422'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.569377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201946b515ff4efa886f22e8a2e6046a', 'request_id': 'req-20e00911-7b32-4618-8eef-dc2565c51422'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.578676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201946b515ff4efa886f22e8a2e6046a', 'request_id': 'req-20e00911-7b32-4618-8eef-dc2565c51422'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.587110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] The token cache is being invalidate because project 201946b515ff4efa886f22e8a2e6046a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:23:03.587405 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.588080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.589940 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1345/2696] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:23:03 2022] DELETE /identity/v3/projects/201946b515ff4efa886f22e8a2e6046a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:03.594304 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:03.604722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9f8d2-f654-4155-b371-4a2a20187414 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:03.624987 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:03.669615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:03.671338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:03.671338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:03.671338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] PATH_INFO: `/v3/users/efdb75073de24d5388e78b4a320dbfb6` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:03.671338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efdb75073de24d5388e78b4a320dbfb6)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:03.674354 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:03.730323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efdb75073de24d5388e78b4a320dbfb6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.730978 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efdb75073de24d5388e78b4a320dbfb6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.731550 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efdb75073de24d5388e78b4a320dbfb6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.738703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efdb75073de24d5388e78b4a320dbfb6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.751126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ce9e27c3-112b-43af-b9de-2e0849638203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efdb75073de24d5388e78b4a320dbfb6'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:03.765751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1352/2697] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:23:03 2022] DELETE /identity/v3/users/efdb75073de24d5388e78b4a320dbfb6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:04.059995 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.061607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:04.076197 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00911-7b32-4618-8eef-dc2565c51422 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.144275 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.145190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.145469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.145740 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] PATH_INFO: `/v3/projects/7fd61e78317541e8b8f7b02010d9690a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.146989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd61e78317541e8b8f7b02010d9690a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.148883 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.189331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:04.208249 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd61e78317541e8b8f7b02010d9690a', 'request_id': 'req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:04.217534 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd61e78317541e8b8f7b02010d9690a', 'request_id': 'req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:04.224437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd61e78317541e8b8f7b02010d9690a', 'request_id': 'req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:04.239528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] The token cache is being invalidate because project 7fd61e78317541e8b8f7b02010d9690a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:23:04.240204 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:04.241175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c00ff760-71e1-4a48-8b1e-9e344ecb72b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:04.248875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1346/2698] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:23:04 2022] DELETE /identity/v3/projects/7fd61e78317541e8b8f7b02010d9690a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:04.251077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.251600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.251711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.271495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:04.272718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:04.340338 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1353/2699] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:04.350062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.350314 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.350672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.371328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:04.372658 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:04.381677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1347/2700] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:04.386193 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.396093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004d084-03c3-4e08-a11b-0ee4938e4cfa None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.401072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.401772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.402021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.402448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.403023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:23:04.403323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.404925 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.417263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1354/2701] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:23:04.421788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.431732 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce193-2e55-4f60-b96d-a3bef4ad750f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.436442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.437206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.437531 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.437848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.438659 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.440800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.469491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1348/2702] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:23:04.474074 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.488592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecc88-03e5-4b73-a731-702901e8b5ba admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.519787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:04.554128 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.554798 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.555079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.555351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.556083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.558101 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.580786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1355/2703] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:23:04.585142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.596600 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b021b55-993c-4b3a-a025-8311d0423b8e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.602633 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.603395 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.603738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.604012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.604806 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.606752 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.619847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1349/2704] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:23:04.624189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.634971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64307d-971a-4aaf-9b82-3a9995bc20fe admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.640215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037a89-6ab8-4d31-87b1-4a2f753a9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.640892 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037a89-6ab8-4d31-87b1-4a2f753a9282 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.641339 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037a89-6ab8-4d31-87b1-4a2f753a9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.641648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037a89-6ab8-4d31-87b1-4a2f753a9282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.642361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11037a89-6ab8-4d31-87b1-4a2f753a9282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.643956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11037a89-6ab8-4d31-87b1-4a2f753a9282 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.655296 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1356/2705] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:23:04.659670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.670089 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6b095-8f95-4744-82e1-9a5cfaf0280d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.676009 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.676898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.677206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.677480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] PATH_INFO: `/v3/projects/cb4775c055004a35980a67e4ad9224ac/users/b4b179be0252422cacf3515c296540d6/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.693799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4775c055004a35980a67e4ad9224ac, user_id=b4b179be0252422cacf3515c296540d6, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.696358 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.710902 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1350/2706] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:23:04 2022] PUT /identity/v3/projects/cb4775c055004a35980a67e4ad9224ac/users/b4b179be0252422cacf3515c296540d6/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:23:04.779600 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.779898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.780139 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.809764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] MFA Rules not processed for user `b4b179be0252422cacf3515c296540d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:04.811023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:04.878300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1357/2707] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:04.883338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:04.949841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c92f2d-f1b4-4cb4-883a-f7a065c040bb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:04.955318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:04.955994 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:04.956304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:04.956737 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:04.957492 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:04.959430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:04.987304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1351/2708] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:23:04.991669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:05.004111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ab85-79b9-4031-91c8-1926f993a43b None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:05.065657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:05.066811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.067103 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.067386 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.068416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:05.070391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:05.093703 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1358/2709] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:23:04 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:23:05.098224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:05.108667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33db7-6e60-4045-8148-87574173dc31 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:05.114102 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:05.115141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.115421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.115715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.116466 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:05.118108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:05.130184 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1352/2710] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:23:05.134955 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:05.145533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63a5c1-0885-4a63-93b6-c2c486fe3314 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:05.150659 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:05.151541 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.151815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.152110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] PATH_INFO: `/v3/projects/373b89e18d5e4f79b87c919627646fa2/users/5303b500720142c4adecd4772d4877a7/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.167808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373b89e18d5e4f79b87c919627646fa2, user_id=5303b500720142c4adecd4772d4877a7, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:05.170498 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:05.194820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1359/2711] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:23:05 2022] PUT /identity/v3/projects/373b89e18d5e4f79b87c919627646fa2/users/5303b500720142c4adecd4772d4877a7/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:05.196498 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:05.208894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a803f-48a0-4459-b67d-2ec79357dd8e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:05.232014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:05.278336 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c94a8-24b9-4d52-8d70-30abe0204199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:05.279044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c94a8-24b9-4d52-8d70-30abe0204199 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.279327 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c94a8-24b9-4d52-8d70-30abe0204199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.279608 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c94a8-24b9-4d52-8d70-30abe0204199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.280356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c94a8-24b9-4d52-8d70-30abe0204199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:05.282026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c94a8-24b9-4d52-8d70-30abe0204199 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:05.293206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1353/2712] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:23:05.297774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:05.304194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:05.310736 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2280d6-04d5-498f-9451-2d56f89e72a7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:05.316805 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:05.317772 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.318054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.318356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] PATH_INFO: `/v3/projects/373b89e18d5e4f79b87c919627646fa2/users/5303b500720142c4adecd4772d4877a7/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.320376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=373b89e18d5e4f79b87c919627646fa2, user_id=5303b500720142c4adecd4772d4877a7, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:05.323162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:05.334525 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1360/2713] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:23:05 2022] PUT /identity/v3/projects/373b89e18d5e4f79b87c919627646fa2/users/5303b500720142c4adecd4772d4877a7/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:05.345059 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.345349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.345623 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.375392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] MFA Rules not processed for user `5303b500720142c4adecd4772d4877a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:05.376605 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:05.455934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1354/2714] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:05.468480 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:05.470549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:05.538369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b35a-e030-48df-aacb-68a5e515abaa admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:05.543173 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d050-fe63-4e93-b67f-5227df4c6245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:05.544662 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d050-fe63-4e93-b67f-5227df4c6245 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:05.545167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d050-fe63-4e93-b67f-5227df4c6245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:05.545496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d050-fe63-4e93-b67f-5227df4c6245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:05.611091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7d050-fe63-4e93-b67f-5227df4c6245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:05.612545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7d050-fe63-4e93-b67f-5227df4c6245 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:05.621970 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1361/2715] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:23:15.310434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:15.311964 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:15.325837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce24c1-6ae2-444f-907b-6da313121b7e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:15.329858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:15.330726 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:15.331010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:15.331287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:15.341959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:15.343428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:15.354380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1355/2716] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:15.617870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:15.830767 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:15.831055 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:15.831440 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:15.849834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] MFA Rules not processed for user `bf1524fd1042430e97bb60caafef26f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:15.851066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:15.910869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1362/2717] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:16.281362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:16.283001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:16.355756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63196bf3-6e53-4a05-b885-b874e5b2adf8 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:16.359634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:16.360325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:16.360831 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:16.361135 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:16.363458 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:16.374796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:16.376270 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:16.386138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1356/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:16.740931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:16.743671 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:16.865900 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99e875-2584-4690-a697-ebf21b239c4e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:16.871631 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:16.872308 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:16.872595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:16.872874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:16.874863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:16.889240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:16.890896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e032fd4-0394-4ebc-9c7c-eb2d0cb6a09d service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:16.904376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1363/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:20.352397 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:20.413290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:20.443618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db6c6-61db-4374-9418-f1ac4b96ab2e service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:20.453377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:20.455061 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:20.455598 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:20.456064 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] PATH_INFO: `/v3/users/b4b179be0252422cacf3515c296540d6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:20.458611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b179be0252422cacf3515c296540d6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:20.462739 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:20.537562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b179be0252422cacf3515c296540d6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:20.538380 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b179be0252422cacf3515c296540d6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:20.539363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b179be0252422cacf3515c296540d6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:20.551503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b179be0252422cacf3515c296540d6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:20.574175 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b179be0252422cacf3515c296540d6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:20.596933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1357/2720] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:23:20 2022] DELETE /identity/v3/users/b4b179be0252422cacf3515c296540d6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:20.601986 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:20.602722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:20.602722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:20.639647 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:20.640267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:20.734956 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1364/2721] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:20.747416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:20.749075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:20.860735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c9b2b-b270-4947-81f3-9555798ea81e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:20.865532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:20.866227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:20.866559 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:20.866832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:20.877702 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:20.879437 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:20.890330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1358/2722] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:23:21.217860 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:21.219461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:21.237578 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a6f4-868d-4b62-906f-976d603b0e28 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:21.245803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:21.246701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:21.247181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:21.247633 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] PATH_INFO: `/v3/projects/cb4775c055004a35980a67e4ad9224ac` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:21.249168 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4775c055004a35980a67e4ad9224ac)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:21.251651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:21.319506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:21.343546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4775c055004a35980a67e4ad9224ac', 'request_id': 'req-b0684649-bc6d-445b-add1-08deba93f2e8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.361899 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4775c055004a35980a67e4ad9224ac', 'request_id': 'req-b0684649-bc6d-445b-add1-08deba93f2e8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.381067 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4775c055004a35980a67e4ad9224ac', 'request_id': 'req-b0684649-bc6d-445b-add1-08deba93f2e8'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.398881 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] The token cache is being invalidate because project cb4775c055004a35980a67e4ad9224ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:23:21.399150 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.400594 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.403297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1365/2723] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:23:21 2022] DELETE /identity/v3/projects/cb4775c055004a35980a67e4ad9224ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:21.407432 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:21.424715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbc2a1-65da-455d-8ce0-c2f0ecc752f9 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:21.503494 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:21.511422 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:21.515783 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:21.516205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:21.516500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] PATH_INFO: `/v3/users/5303b500720142c4adecd4772d4877a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:21.518304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5303b500720142c4adecd4772d4877a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:21.520508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:21.588537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5303b500720142c4adecd4772d4877a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.589889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5303b500720142c4adecd4772d4877a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.590225 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5303b500720142c4adecd4772d4877a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.600518 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5303b500720142c4adecd4772d4877a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.617950 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c3436657-b93e-4fdf-86f2-569c2e91e210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5303b500720142c4adecd4772d4877a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:21.637396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1359/2724] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:23:21 2022] DELETE /identity/v3/users/5303b500720142c4adecd4772d4877a7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:22.091916 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.093468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:22.111217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0684649-bc6d-445b-add1-08deba93f2e8 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.181336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.182187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.182471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.182761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] PATH_INFO: `/v3/projects/373b89e18d5e4f79b87c919627646fa2` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.184050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373b89e18d5e4f79b87c919627646fa2)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.186188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.235093 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373b89e18d5e4f79b87c919627646fa2', 'request_id': 'req-113c41a1-fb83-4d15-9874-81061ab26418'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:22.243367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373b89e18d5e4f79b87c919627646fa2', 'request_id': 'req-113c41a1-fb83-4d15-9874-81061ab26418'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:22.249670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373b89e18d5e4f79b87c919627646fa2', 'request_id': 'req-113c41a1-fb83-4d15-9874-81061ab26418'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:22.262267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] The token cache is being invalidate because project 373b89e18d5e4f79b87c919627646fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:23:22.262576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:22.263294 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-113c41a1-fb83-4d15-9874-81061ab26418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:22.264945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1366/2725] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:23:22 2022] DELETE /identity/v3/projects/373b89e18d5e4f79b87c919627646fa2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:22.271343 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.271632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.271913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.290907 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:22.292121 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:22.354335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1360/2726] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:22.364187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.364834 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.365213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.385661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:22.386098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:22.395051 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1367/2727] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:22.399429 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.409549 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc3594-8ca4-49bf-92bf-6782fd2c75c0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.415131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.415792 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.416108 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.416379 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.417165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:23:22.417472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.419085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.433081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1361/2728] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:23:22.438530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.448110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75d497-8116-46a9-aea4-3278811023e8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.453065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.453818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.454169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.454504 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.455267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.457432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.498048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1368/2729] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:23:22 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:23:22.502404 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.514722 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b48a4-d89a-4630-8e25-cc2456c41274 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.576092 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.576858 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.577142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.577460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.578140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.580095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.589988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:22.615791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1362/2730] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:23:22 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:23:22.616638 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.626334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55269bf-02c6-4945-a9a3-ce74f7f70538 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.631180 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.631953 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.632245 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.632526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.633306 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.635013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.646300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1369/2731] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:23:22.650550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.662005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb353d9e-88c6-4389-85af-d679f760d621 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.667005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a0735-bcfa-4d09-9fe6-63ca55a10f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.667719 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a0735-bcfa-4d09-9fe6-63ca55a10f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.668006 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a0735-bcfa-4d09-9fe6-63ca55a10f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.668287 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a0735-bcfa-4d09-9fe6-63ca55a10f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.669063 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a0735-bcfa-4d09-9fe6-63ca55a10f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.670691 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a0735-bcfa-4d09-9fe6-63ca55a10f08 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.682908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1363/2732] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:23:22.687465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.698648 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2b6d8-15a1-435a-af2a-9a92cce792ef admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.706810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.707755 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.708038 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.708312 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] PATH_INFO: `/v3/projects/9b86dccbbc8a400db2191740ea1222a6/users/5784c5f9cb984dc8ae8878222375c888/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.714684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:22.733078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b86dccbbc8a400db2191740ea1222a6, user_id=5784c5f9cb984dc8ae8878222375c888, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.736152 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.753913 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1370/2733] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:23:22 2022] PUT /identity/v3/projects/9b86dccbbc8a400db2191740ea1222a6/users/5784c5f9cb984dc8ae8878222375c888/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:22.767911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3b29-7639-4402-b13d-531dc338918f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.768262 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3b29-7639-4402-b13d-531dc338918f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.768548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3b29-7639-4402-b13d-531dc338918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.801440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-15ff3b29-7639-4402-b13d-531dc338918f None None] MFA Rules not processed for user `5784c5f9cb984dc8ae8878222375c888`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:22.802687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-15ff3b29-7639-4402-b13d-531dc338918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:22.871110 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1364/2734] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:22.883367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:22.885418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:22.947047 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c0cf-0cc2-46d9-9c51-124e131b146d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:22.950832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:22.951481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:22.951765 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:22.952032 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:22.961212 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:22.962651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:22.971832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1371/2735] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:32.867933 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:32.967575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:36.456837 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:36.457618 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:36.457920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:36.482263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] MFA Rules not processed for user `6ccfbda39c494fcfadded542666d3df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:36.484381 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:36.558557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1365/2736] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:36.877063 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:36.879409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:36.964111 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00230-6e91-4f73-91d2-2dc84597bedf service glance] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:36.967931 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:36.968577 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:36.968852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:36.969179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:36.971029 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:36.982462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:36.983924 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:36.994564 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1372/2737] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:38.071408 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:38.074128 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:38.204415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa4a3-c535-47fc-9c55-93f29aaf92d8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:38.212371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:38.213104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:38.213356 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:38.213634 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:38.215577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:38.230669 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:38.233592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:38.249601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1366/2738] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:42.558914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:42.561075 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:42.585426 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b583-69d2-4649-aa59-9133331fc8ab service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:42.591585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:42.592503 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:42.592995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:42.593797 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:42.596358 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:42.613815 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:42.616100 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931ef26-a59c-4916-8234-13acb256a403 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:42.633236 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1373/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:48.251140 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=59 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:52.624698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=32 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:52.658973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:52.729899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970faf25-cffa-4c79-b57a-18ea75e5a898 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:52.738268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:52.740176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:52.740653 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:52.741164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] PATH_INFO: `/v3/users/5784c5f9cb984dc8ae8878222375c888` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:52.743890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5784c5f9cb984dc8ae8878222375c888)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:52.747644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:52.825615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5784c5f9cb984dc8ae8878222375c888'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:52.826317 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5784c5f9cb984dc8ae8878222375c888'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:52.826975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5784c5f9cb984dc8ae8878222375c888'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:52.837847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5784c5f9cb984dc8ae8878222375c888'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:52.856469 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5784c5f9cb984dc8ae8878222375c888'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:52.881635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1367/2740] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:23:52 2022] DELETE /identity/v3/users/5784c5f9cb984dc8ae8878222375c888 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:52.885846 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:52.886267 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:52.886668 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:52.908652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:52.909910 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:52.986917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1374/2741] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:53.002637 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:53.004901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:53.073624 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f399f-7d08-4d9e-8ee5-38311c2bf76e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:53.077433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f119708-366d-454a-935c-681c5617b3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:53.078100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f119708-366d-454a-935c-681c5617b3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:53.078384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f119708-366d-454a-935c-681c5617b3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:53.078663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f119708-366d-454a-935c-681c5617b3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:53.090820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f119708-366d-454a-935c-681c5617b3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:53.092273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f119708-366d-454a-935c-681c5617b3f4 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:53.103173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1368/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:23:53.445741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:53.448095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:53.470402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a281e-04b5-4bdb-ac0c-dd024c22f235 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:53.478942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:53.479824 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:53.480108 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:53.480378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] PATH_INFO: `/v3/projects/9b86dccbbc8a400db2191740ea1222a6` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:53.484491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b86dccbbc8a400db2191740ea1222a6)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:53.486461 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:53.558159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b86dccbbc8a400db2191740ea1222a6', 'request_id': 'req-22d002fe-d89e-4c13-9e36-0c74ccb8f252'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:53.571701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b86dccbbc8a400db2191740ea1222a6', 'request_id': 'req-22d002fe-d89e-4c13-9e36-0c74ccb8f252'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:53.584065 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b86dccbbc8a400db2191740ea1222a6', 'request_id': 'req-22d002fe-d89e-4c13-9e36-0c74ccb8f252'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:53.603690 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] The token cache is being invalidate because project 9b86dccbbc8a400db2191740ea1222a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:23:53.604167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:53.609081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-22d002fe-d89e-4c13-9e36-0c74ccb8f252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:23:53.609081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1375/2743] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:23:53 2022] DELETE /identity/v3/projects/9b86dccbbc8a400db2191740ea1222a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:53.615423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:53.615904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:53.616362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:53.644572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:53.646592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:53.675561 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:53.748735 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1369/2744] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:53.758927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:53.759501 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:53.760077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:53.787013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:53.788252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:53.796495 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1376/2745] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:23:53.801076 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:53.812112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc8fd-b855-4c70-98c5-92312a14dc7d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:53.821136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:53.822057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:53.822394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:53.822723 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:53.823546 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:23:53.823917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:53.825785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:53.845241 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1370/2746] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:23:53.851442 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:53.868138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a3ac9-c703-4604-9945-3ef546c2dc70 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:53.876291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:53.877301 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:53.877836 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:53.878927 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:53.879158 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:53.882468 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:53.923636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1377/2747] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:23:53 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:23:53.930612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:53.951329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c07d-5cbe-425b-b5cb-28f3c89a3283 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:54.057820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:54.059171 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:54.059677 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:54.060112 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:54.061449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:54.065057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:54.092956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1371/2748] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:23:53 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:23:54.097388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:54.108210 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac375f-d0b0-471d-97c6-d95b6bccf9ee admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:54.113330 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:54.114585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:54.114982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:54.115351 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:54.116280 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:54.118027 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:54.134894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1378/2749] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:23:54.141332 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:54.159538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe42d2-9d9a-457e-9ee3-f30439d90df3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:54.167672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1fac5-ad73-43c4-bf6e-09ac9d1ad0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:54.168836 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1fac5-ad73-43c4-bf6e-09ac9d1ad0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:54.169392 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1fac5-ad73-43c4-bf6e-09ac9d1ad0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:54.169890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1fac5-ad73-43c4-bf6e-09ac9d1ad0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:54.171272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1fac5-ad73-43c4-bf6e-09ac9d1ad0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:54.174312 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1fac5-ad73-43c4-bf6e-09ac9d1ad0a3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:54.189753 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1372/2750] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:23:54.196473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:54.213522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215004-299d-44dd-8904-e3bc4d35b952 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:54.219810 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:54.220879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:54.221414 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:54.221820 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] PATH_INFO: `/v3/projects/68f45382c9c34bb2bb2329781e29e513/users/3bffa5ebcc0b4118a507b9083ae632bf/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:54.240334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f45382c9c34bb2bb2329781e29e513, user_id=3bffa5ebcc0b4118a507b9083ae632bf, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:54.243326 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:54.263667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1379/2751] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:23:54 2022] PUT /identity/v3/projects/68f45382c9c34bb2bb2329781e29e513/users/3bffa5ebcc0b4118a507b9083ae632bf/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:23:54.281045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:54.281547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:54.281979 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:54.324096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] MFA Rules not processed for user `3bffa5ebcc0b4118a507b9083ae632bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:23:54.325992 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:54.421213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1373/2752] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:23:54.435082 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:23:54.437246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:23:54.466278 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:54.510470 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e8fba-c8b2-4582-b77f-7c0470608dda admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:23:54.516890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce82fc-13ab-4d7a-a779-910c05bdff90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:23:54.518333 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce82fc-13ab-4d7a-a779-910c05bdff90 service glance] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:23:54.518962 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce82fc-13ab-4d7a-a779-910c05bdff90 service glance] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:23:54.519684 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce82fc-13ab-4d7a-a779-910c05bdff90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:23:54.536194 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce82fc-13ab-4d7a-a779-910c05bdff90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:23:54.539034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce82fc-13ab-4d7a-a779-910c05bdff90 service glance] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:23:54.554574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1380/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:23:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:24:04.417477 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:04.546641 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=17 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:51.949057 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:24:52.101820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e611c2-9036-44d8-8356-9399f60ec348 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:24:52.109036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:24:52.110117 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:24:52.110470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:24:52.110827 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] PATH_INFO: `/v3/users/3bffa5ebcc0b4118a507b9083ae632bf` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:24:52.112676 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bffa5ebcc0b4118a507b9083ae632bf)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:24:52.115490 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:24:52.177602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bffa5ebcc0b4118a507b9083ae632bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:52.178331 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bffa5ebcc0b4118a507b9083ae632bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:52.179083 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bffa5ebcc0b4118a507b9083ae632bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:52.188781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bffa5ebcc0b4118a507b9083ae632bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:52.206651 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bffa5ebcc0b4118a507b9083ae632bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:52.232744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1374/2754] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:24:51 2022] DELETE /identity/v3/users/3bffa5ebcc0b4118a507b9083ae632bf => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:24:52.239841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:24:52.240464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:24:52.240464 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:24:52.297142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:24:52.298474 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:24:52.379244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1381/2755] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:24:52.391731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:24:52.393500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:24:52.446452 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:52.512548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93903ddf-5b50-4001-a304-833bd8263019 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:24:52.517511 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:24:52.518628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:24:52.519060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:24:52.519544 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:24:52.533394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:24:52.534895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:24:52.546144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1375/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:24:52.903535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:24:52.906238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:24:52.927371 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf36a3-3dbe-4ee0-8383-6bff4ca817e9 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:24:52.934078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:24:52.934966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:24:52.935252 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:24:52.935527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] PATH_INFO: `/v3/projects/68f45382c9c34bb2bb2329781e29e513` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:24:52.936794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f45382c9c34bb2bb2329781e29e513)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:24:52.938786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:24:53.016522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f45382c9c34bb2bb2329781e29e513', 'request_id': 'req-0a2382e3-6107-4e5c-8313-08719055833a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:53.030368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f45382c9c34bb2bb2329781e29e513', 'request_id': 'req-0a2382e3-6107-4e5c-8313-08719055833a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:53.040908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f45382c9c34bb2bb2329781e29e513', 'request_id': 'req-0a2382e3-6107-4e5c-8313-08719055833a'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:53.059809 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] The token cache is being invalidate because project 68f45382c9c34bb2bb2329781e29e513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:24:53.060290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:53.060914 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:24:53.063490 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1382/2757] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:24:52 2022] DELETE /identity/v3/projects/68f45382c9c34bb2bb2329781e29e513 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:24:56.738860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:24:56.740593 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:24:56.859021 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a160a-d63d-4eca-b3af-fa5f2fc38717 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:24:56.938959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:24:56.940742 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:24:56.941144 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:24:56.941694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:24:56.944227 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:24:56.967289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:24:56.969335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:24:56.981109 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1376/2758] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:25:01.923229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:01.926198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:02.032097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:02.036694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2382e3-6107-4e5c-8313-08719055833a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:02.044605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:02.045742 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.046135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.046548 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] PATH_INFO: `/v3/users/6ccfbda39c494fcfadded542666d3df3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.048634 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccfbda39c494fcfadded542666d3df3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:02.051886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:02.111630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccfbda39c494fcfadded542666d3df3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.112325 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccfbda39c494fcfadded542666d3df3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.113361 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccfbda39c494fcfadded542666d3df3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.121162 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccfbda39c494fcfadded542666d3df3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.134256 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-29706160-55fc-4753-ba4c-8dfbe3b70ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccfbda39c494fcfadded542666d3df3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.151497 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1383/2759] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:25:01 2022] DELETE /identity/v3/users/6ccfbda39c494fcfadded542666d3df3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:02.359020 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:02.378430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0e6ac-f4e6-4960-b063-a690ca577341 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:02.400472 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:02.476166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:02.477030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.477329 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.477612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] PATH_INFO: `/v3/projects/dbeb18fed89a458e9ba2a998a73fe899` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.479130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbeb18fed89a458e9ba2a998a73fe899)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:02.481115 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:02.535363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbeb18fed89a458e9ba2a998a73fe899', 'request_id': 'req-f0a01648-df9a-47e9-b017-4e336b27be5e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.549272 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbeb18fed89a458e9ba2a998a73fe899', 'request_id': 'req-f0a01648-df9a-47e9-b017-4e336b27be5e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.558562 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbeb18fed89a458e9ba2a998a73fe899', 'request_id': 'req-f0a01648-df9a-47e9-b017-4e336b27be5e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.578982 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] The token cache is being invalidate because project dbeb18fed89a458e9ba2a998a73fe899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:25:02.579497 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.580689 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f0a01648-df9a-47e9-b017-4e336b27be5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:02.583555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1377/2760] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:25:02 2022] DELETE /identity/v3/projects/dbeb18fed89a458e9ba2a998a73fe899 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:02.589721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.590059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.590380 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.645455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:02.646707 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:02.723995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1384/2761] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:02.732725 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.733052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.733362 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.754886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:02.756137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:02.764611 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1378/2762] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:02.770142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:02.781945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f893-251a-4a6b-b85b-4ca1ccac238f None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:02.789695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:02.790867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.791383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.791884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.793266 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:25:02.793838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:02.796652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:02.829817 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1385/2763] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:25:02.834604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:02.849295 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93523f-0d61-445d-a691-adcf7c0ee0f4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:02.857935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:02.859809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.859809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.859809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.859809 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:02.861671 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:02.893997 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1379/2764] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:25:02 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:25:02.898384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:02.911428 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea15e6-2eec-47a7-9aa6-8b72fd932b59 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:02.957949 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:02.992792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:02.993895 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:02.994366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:02.994832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:02.995926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:02.999095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:03.030004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1386/2765] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:25:02 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:25:03.034973 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:03.048414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12798f45-4237-4a85-8a7c-79e00b703307 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:03.056377 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:03.057470 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:03.057853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:03.058290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:03.059355 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:03.062077 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:03.081988 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1380/2766] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:25:03.087431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:03.101261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19d5f0-734d-4f1c-a65d-167387e95572 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:03.109621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463434b-13a0-4ce6-abf1-1ad1318917ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:03.110764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463434b-13a0-4ce6-abf1-1ad1318917ff admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:03.111537 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463434b-13a0-4ce6-abf1-1ad1318917ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:03.112034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463434b-13a0-4ce6-abf1-1ad1318917ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:03.113842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463434b-13a0-4ce6-abf1-1ad1318917ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:03.116879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463434b-13a0-4ce6-abf1-1ad1318917ff admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:03.136909 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1387/2767] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:25:03.141887 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:03.153055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed999-89a6-41a5-b0f1-2b858a3a7cec admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:03.158875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:03.159962 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:03.160291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:03.160609 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] PATH_INFO: `/v3/projects/90a56b460f5a4b58a23daf1428514cee/users/1dd1ec26e4ed462481edaa8af084e397/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:03.183055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a56b460f5a4b58a23daf1428514cee, user_id=1dd1ec26e4ed462481edaa8af084e397, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:03.187699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:03.203779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1381/2768] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:25:03 2022] PUT /identity/v3/projects/90a56b460f5a4b58a23daf1428514cee/users/1dd1ec26e4ed462481edaa8af084e397/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:25:03.215473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:03.215778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:03.216135 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:03.249307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] MFA Rules not processed for user `1dd1ec26e4ed462481edaa8af084e397`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:03.250529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:03.331157 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1388/2769] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:03.344442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:03.347252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:03.418189 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:03.436538 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f3c7-be65-4c09-b24f-a6f366b71d2d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:03.441910 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244404-a5f1-4096-ab3f-4ee8f7ef1b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:03.442711 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244404-a5f1-4096-ab3f-4ee8f7ef1b82 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:03.443045 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244404-a5f1-4096-ab3f-4ee8f7ef1b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:03.443371 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244404-a5f1-4096-ab3f-4ee8f7ef1b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:03.453699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73244404-a5f1-4096-ab3f-4ee8f7ef1b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:03.455972 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73244404-a5f1-4096-ab3f-4ee8f7ef1b82 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:03.467822 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1382/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:25:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:25:13.327138 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:13.461766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:27.634674 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:27.713711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b85156-3a8e-4dfd-9173-5dfa073af185 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:27.718471 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:27.719375 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:27.719661 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:27.720030 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] PATH_INFO: `/v3/users/1dd1ec26e4ed462481edaa8af084e397` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:27.721360 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd1ec26e4ed462481edaa8af084e397)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:27.723311 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:27.788409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd1ec26e4ed462481edaa8af084e397'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:27.789196 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd1ec26e4ed462481edaa8af084e397'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:27.789915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd1ec26e4ed462481edaa8af084e397'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:27.798025 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd1ec26e4ed462481edaa8af084e397'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:27.814695 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd1ec26e4ed462481edaa8af084e397'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:27.831291 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1389/2771] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:25:27 2022] DELETE /identity/v3/users/1dd1ec26e4ed462481edaa8af084e397 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:25:27.837328 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:27.837890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:27.837890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:27.857305 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:27.859289 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:27.942306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1383/2772] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:27.952875 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:27.955383 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:28.035581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463b7a-2b90-45bc-8d92-31283490acc6 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:28.039496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e346a-0cfe-44c1-8125-21edbae7bf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:28.040226 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e346a-0cfe-44c1-8125-21edbae7bf6e service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.040549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e346a-0cfe-44c1-8125-21edbae7bf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.040906 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e346a-0cfe-44c1-8125-21edbae7bf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.052262 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e346a-0cfe-44c1-8125-21edbae7bf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:28.054620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e346a-0cfe-44c1-8125-21edbae7bf6e service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:28.066036 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1390/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:25:28.395130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:28.395796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:28.412863 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fa01d-8ccb-4bfe-9bd8-dd4302568aa6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:28.417663 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:28.418579 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.418866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.419149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] PATH_INFO: `/v3/projects/90a56b460f5a4b58a23daf1428514cee` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.420449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a56b460f5a4b58a23daf1428514cee)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:28.423105 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:28.502283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a56b460f5a4b58a23daf1428514cee', 'request_id': 'req-7212b953-df13-4a8a-93c8-184388b7ac85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:28.512091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a56b460f5a4b58a23daf1428514cee', 'request_id': 'req-7212b953-df13-4a8a-93c8-184388b7ac85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:28.518894 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a56b460f5a4b58a23daf1428514cee', 'request_id': 'req-7212b953-df13-4a8a-93c8-184388b7ac85'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:28.533755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] The token cache is being invalidate because project 90a56b460f5a4b58a23daf1428514cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:25:28.534257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:28.535370 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7212b953-df13-4a8a-93c8-184388b7ac85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:28.538211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1384/2774] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:25:28 2022] DELETE /identity/v3/projects/90a56b460f5a4b58a23daf1428514cee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:28.545794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.546264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.546620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.576902 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:28.579105 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:28.611540 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:28.665283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1391/2775] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:25:28.675652 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.676218 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.676729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.705163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:28.707330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:28.720213 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1385/2776] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:28.725183 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:28.740788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e40a8-7ceb-44a6-a752-95311e0472e7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:28.748186 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:28.748938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.749250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.749524 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.750273 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:25:28.750649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:28.753116 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:28.771596 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1392/2777] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:25:28.776308 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:28.786929 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5542a8-444f-4d6b-acdc-e3063c16bf5d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:28.791906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:28.792620 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.792901 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.793299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.793931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:28.795850 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:28.833096 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1386/2778] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:25:28 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:25:28.838792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:28.854606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2198d1-68f3-45b2-9288-b4611f140eb9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:28.962741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:28.963466 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:28.963746 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:28.964023 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:28.964788 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:28.966865 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:28.991561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1393/2779] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:25:28 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:25:28.997473 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:29.014440 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58a4f-f8f1-467b-8536-d8e695a577f4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:29.020228 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:29.021163 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:29.021502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:29.021911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:29.022955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:29.024904 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:29.041527 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1387/2780] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:25:29.047640 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:29.058485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd6f4-6d7c-4876-a27c-a8116a7103fe admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:29.064261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d76f-869a-4a85-865c-c0fb7a582392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:29.064947 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d76f-869a-4a85-865c-c0fb7a582392 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:29.065269 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d76f-869a-4a85-865c-c0fb7a582392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:29.066042 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d76f-869a-4a85-865c-c0fb7a582392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:29.066388 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d76f-869a-4a85-865c-c0fb7a582392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:29.067934 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d76f-869a-4a85-865c-c0fb7a582392 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:29.083398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1394/2781] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:25:29.088018 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:29.104290 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e071ec-9ef7-4c59-984d-f08bf50692dc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:29.109320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:29.110267 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:29.110890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:29.110890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] PATH_INFO: `/v3/projects/e94ac089c7dd468b8f0ca7f8fa14769e/users/0ff2575eecdc4e668844f62411861db9/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:29.132383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ac089c7dd468b8f0ca7f8fa14769e, user_id=0ff2575eecdc4e668844f62411861db9, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:29.135507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:29.152254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1388/2782] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:25:29 2022] PUT /identity/v3/projects/e94ac089c7dd468b8f0ca7f8fa14769e/users/0ff2575eecdc4e668844f62411861db9/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:29.159213 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87b94-fff2-4fbc-8d30-0955b177f3ef None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:29.159512 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87b94-fff2-4fbc-8d30-0955b177f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:29.159796 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87b94-fff2-4fbc-8d30-0955b177f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:29.179499 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-fdb87b94-fff2-4fbc-8d30-0955b177f3ef None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:29.180725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-fdb87b94-fff2-4fbc-8d30-0955b177f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:29.250050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1395/2783] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:29.261480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:29.263621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:29.290046 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:29.341126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e124-96e8-4e6e-98e7-abda5a70f1b9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:29.346694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:29.347721 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:29.348178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:29.348622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:29.359415 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:29.360909 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:29.372455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1389/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:25:35.430022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:35.430935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:35.431192 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:35.462053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] MFA Rules not processed for user `0ff2575eecdc4e668844f62411861db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:35.463297 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:35.483401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:35.567270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1396/2785] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:25:35.574617 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:35.594257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a29d9-2326-4d4a-828f-62cfd72f017b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:35.602645 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:35.603521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:35.604612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:35.605232 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:35.606588 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:35.610170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:35.662348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1390/2786] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:25:35 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:25:35.667882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:35.681130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8accd-43fa-4e55-8655-7dab67ccd7f1 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:35.785347 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:35.786418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:35.786928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:35.787299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:35.788558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:35.792368 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:35.823555 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1397/2787] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:25:35 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:25:35.829787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:35.846080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811b5af-68c8-46cb-af51-06d22df2849c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:35.853286 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:35.854364 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:35.854864 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:35.855363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:35.856731 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:35.859848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:35.873675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1391/2788] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:25:35.879416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:35.902741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9147eeb-d774-4192-bf0e-3304e898293a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:35.910078 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:35.911505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:35.911943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:35.912369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] PATH_INFO: `/v3/projects/e9a55f5d9b3d4c61ba0100968066d0b7/users/99227c5dc50040bfbcb4f505f3f02659/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:35.933260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a55f5d9b3d4c61ba0100968066d0b7, user_id=99227c5dc50040bfbcb4f505f3f02659, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:35.936059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:35.963701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1398/2789] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:25:35 2022] PUT /identity/v3/projects/e9a55f5d9b3d4c61ba0100968066d0b7/users/99227c5dc50040bfbcb4f505f3f02659/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:35.969543 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:35.986961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043af776-8d9e-45fb-9cc3-acaa6df822d5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:36.087320 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f05a-76d7-40c0-9b2a-0a1e51d982c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:36.088450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f05a-76d7-40c0-9b2a-0a1e51d982c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:36.088841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f05a-76d7-40c0-9b2a-0a1e51d982c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:36.089255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f05a-76d7-40c0-9b2a-0a1e51d982c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:36.090221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4f05a-76d7-40c0-9b2a-0a1e51d982c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:36.093240 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4f05a-76d7-40c0-9b2a-0a1e51d982c1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:36.108839 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1392/2790] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:25:36.115979 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:36.132874 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eda53-8097-404d-bf67-09d8627e65bb admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:36.140721 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:36.142179 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:36.142481 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:36.142879 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] PATH_INFO: `/v3/projects/e9a55f5d9b3d4c61ba0100968066d0b7/users/99227c5dc50040bfbcb4f505f3f02659/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:36.145574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a55f5d9b3d4c61ba0100968066d0b7, user_id=99227c5dc50040bfbcb4f505f3f02659, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:36.148316 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:36.161113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1399/2791] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:25:36 2022] PUT /identity/v3/projects/e9a55f5d9b3d4c61ba0100968066d0b7/users/99227c5dc50040bfbcb4f505f3f02659/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:44.436221 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:44.437101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:44.437274 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:44.492636 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] MFA Rules not processed for user `99227c5dc50040bfbcb4f505f3f02659`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:44.494548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:44.645060 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1393/2792] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:25:44.662419 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:44.666283 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:44.786073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:44.788014 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:44.809884 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:44.815943 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b32d5-2be5-48e4-9cad-2f02e16cfdbc admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:44.820431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291efe-a61d-44b6-9fb6-2853fbcc540b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '643c0511de594207bf8fbdd5b295267f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:44.821118 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291efe-a61d-44b6-9fb6-2853fbcc540b service glance] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:44.821398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291efe-a61d-44b6-9fb6-2853fbcc540b service glance] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:44.821672 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291efe-a61d-44b6-9fb6-2853fbcc540b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:44.826733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:44.913678 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728fe87-c36d-4ca0-a3c7-969d1a7dddcf None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:44.919991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:44.920221 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291efe-a61d-44b6-9fb6-2853fbcc540b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:44.921190 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:44.921672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:44.921882 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291efe-a61d-44b6-9fb6-2853fbcc540b service glance] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:44.922147 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:44.925991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:44.934808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1400/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:25:45.066304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:45.068318 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:45.081613 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1394/2794] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:25:45.118651 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:45.119275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:45.119890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:45.172270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:45.174787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:45.337761 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1401/2795] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:25:45.418130 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:45.420787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:45.545908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22ea3-4ffd-411c-964c-b6477e1ab9a6 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:45.558070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:45.558070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:45.558070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:45.558070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:45.563224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:45.565325 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:45.575468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1395/2796] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:25:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:51.646164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:51.647710 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:51.814612 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67571db6-6d5e-473b-bd41-aabb31a79360 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:51.828160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:51.828935 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:51.829250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:51.830178 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:51.831566 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:51.845097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:51.846786 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:51.864227 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1402/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:25:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:25:55.571398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=77 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:56.981206 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:56.982983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:57.007236 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b3f3-7147-4266-9b97-8de36e556b03 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:57.013975 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:57.015526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:57.015921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:57.016521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] PATH_INFO: `/v3/users/43f9e7923ebb4939ac2bd590270b48d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:57.039575 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f9e7923ebb4939ac2bd590270b48d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:57.042407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:57.152179 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f9e7923ebb4939ac2bd590270b48d7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.152965 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f9e7923ebb4939ac2bd590270b48d7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.153782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f9e7923ebb4939ac2bd590270b48d7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.166520 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f9e7923ebb4939ac2bd590270b48d7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.196991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f9e7923ebb4939ac2bd590270b48d7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.239959 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1396/2798] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:25:56 2022] DELETE /identity/v3/users/43f9e7923ebb4939ac2bd590270b48d7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:57.546449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:57.569237 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38c0d-27ff-4ecf-9df9-44cf7e2d39e2 service placement] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:57.624733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=100 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:57.707488 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:57.708484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:57.708859 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:57.709313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] PATH_INFO: `/v3/projects/03491cee113744268fc89b63330c21c2` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:57.724989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03491cee113744268fc89b63330c21c2)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:57.727250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:57.848694 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03491cee113744268fc89b63330c21c2', 'request_id': 'req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.873002 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03491cee113744268fc89b63330c21c2', 'request_id': 'req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.894785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03491cee113744268fc89b63330c21c2', 'request_id': 'req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.917743 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] The token cache is being invalidate because project 03491cee113744268fc89b63330c21c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:25:57.918624 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.919670 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:57.929285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1403/2799] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:25:57 2022] DELETE /identity/v3/projects/03491cee113744268fc89b63330c21c2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:57.929720 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:57.931919 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:57.955736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff480e-5094-4f31-bac0-81753815f82e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:58.055303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:58.056401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:58.056763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:58.057106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] PATH_INFO: `/v3/users/4a109c7db3b342f1bfed0dad57d690c2` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:58.058679 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a109c7db3b342f1bfed0dad57d690c2)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:58.062584 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:58.148265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a109c7db3b342f1bfed0dad57d690c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.149361 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a109c7db3b342f1bfed0dad57d690c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.150421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a109c7db3b342f1bfed0dad57d690c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.163848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a109c7db3b342f1bfed0dad57d690c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.171586 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:58.188852 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c512ca74-d925-4cbe-8c82-7b75b25738b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a109c7db3b342f1bfed0dad57d690c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.206085 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1397/2800] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:25:57 2022] DELETE /identity/v3/users/4a109c7db3b342f1bfed0dad57d690c2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:25:58.468277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:25:58.470843 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:58.488261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a0dd-6fa3-4047-ac91-512f7ac7b7d2 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:25:58.542195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a114f7e-6c4a-4fad-b878-d8ad4c755ba9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:58.542747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a114f7e-6c4a-4fad-b878-d8ad4c755ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:58.543352 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a114f7e-6c4a-4fad-b878-d8ad4c755ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:58.562540 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0a114f7e-6c4a-4fad-b878-d8ad4c755ba9 None None] MFA Rules not processed for user `0ff2575eecdc4e668844f62411861db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:25:58.563991 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0a114f7e-6c4a-4fad-b878-d8ad4c755ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:25:58.572298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:25:58.573863 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:25:58.574639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:25:58.574639 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] PATH_INFO: `/v3/projects/defabc29eadd4d31b527fd0a1226fbd8` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:25:58.576785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=defabc29eadd4d31b527fd0a1226fbd8)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:25:58.579006 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:25:58.645668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1398/2801] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:25:58.647009 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:58.652595 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'defabc29eadd4d31b527fd0a1226fbd8', 'request_id': 'req-9f474d06-8108-48ee-98df-0e8d0df02958'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.669155 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'defabc29eadd4d31b527fd0a1226fbd8', 'request_id': 'req-9f474d06-8108-48ee-98df-0e8d0df02958'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.677147 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'defabc29eadd4d31b527fd0a1226fbd8', 'request_id': 'req-9f474d06-8108-48ee-98df-0e8d0df02958'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.692603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] The token cache is being invalidate because project defabc29eadd4d31b527fd0a1226fbd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:25:58.693037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.694014 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:25:58.696290 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1404/2802] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:25:58 2022] DELETE /identity/v3/projects/defabc29eadd4d31b527fd0a1226fbd8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:26:00.829157 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:26:00.830043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:26:00.830043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:26:00.849744 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:26:00.853122 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:00.954400 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1399/2803] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jun 7 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:26:00.978808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:26:00.981441 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:01.082702 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474d06-8108-48ee-98df-0e8d0df02958 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:26:01.088459 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a798bf-f38d-4935-a38c-be06bf9f4682 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:26:01.089151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a798bf-f38d-4935-a38c-be06bf9f4682 service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:26:01.089431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a798bf-f38d-4935-a38c-be06bf9f4682 service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:26:01.089709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a798bf-f38d-4935-a38c-be06bf9f4682 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:26:01.111539 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a798bf-f38d-4935-a38c-be06bf9f4682 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:26:01.114154 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a798bf-f38d-4935-a38c-be06bf9f4682 service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:26:01.126533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1405/2804] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:26:02.096224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:26:02.097873 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:02.265216 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a70ca-5d96-4e1e-b504-fc660db93ece None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:26:02.277718 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:26:02.279354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:26:02.279917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:26:02.280475 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:26:02.284759 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:02.354587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:02.439088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:26:02.441161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:26:02.455174 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1400/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:26:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 13:26:11.123349 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:12.448062 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=15 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:30.400261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:26:30.400930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:26:30.400930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:26:30.420248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] MFA Rules not processed for user `bf1524fd1042430e97bb60caafef26f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:26:30.421535 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:30.428905 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1406/2806] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:26:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:26:34.573516 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:26:34.581970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:34.655684 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0d120-f709-4bba-8a3a-d7a31244d6ba service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:26:34.659937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:26:34.660628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:26:34.660908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:26:34.661217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:26:34.663104 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:26:34.739037 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:26:34.740536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:26:34.753765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1401/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:26:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:26:40.415146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:44.747442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=50 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.982421 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:27:38.994052 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb97e4e-e412-4f43-9bcc-365520547055 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:27:38.998018 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:27:38.998951 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:27:38.999494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:27:39.000136 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:27:39.002513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:27:39.004833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:27:39.019103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76be319-2e4c-4a46-8b6f-98771c58324b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:27:39.023028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:27:39.023698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:27:39.023977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:27:39.024251 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:27:39.026237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:27:39.042164 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:27:39.044943 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:27:39.048708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:27:39.050811 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:27:39.061842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1402/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:27:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:27:39.082429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1407/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:27:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:27:40.391413 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:27:40.393030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:27:40.404533 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f810b7b-3e53-4ecd-bec2-f397eb5e4835 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:27:40.408548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:27:40.409244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:27:40.409532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:27:40.409813 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:27:40.411727 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:27:40.428238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:27:40.429777 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:27:40.443547 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1403/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:27:49.078205 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=15 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:50.437739 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=12 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:18.029739 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:18.031821 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:18.046632 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10c24-2b35-4c7b-9d67-c9a8f39386df service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:18.055000 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:18.055917 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:18.056110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:18.056397 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:18.058908 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:18.078220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:18.080102 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:18.104007 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1408/2811] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:23.398335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:23.410205 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1950e6-caff-4f7b-8032-27669e996c84 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:23.414853 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:23.415515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:23.415800 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:23.416074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:23.418303 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:23.486386 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:23.487833 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:23.497743 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1404/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:27.122357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:27.124384 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:27.144853 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c54e4-98e3-4525-817e-62ac507f6a40 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:27.151215 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:27.152114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.152391 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.152665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] PATH_INFO: `/v3/users/bf1524fd1042430e97bb60caafef26f3` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.154084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1524fd1042430e97bb60caafef26f3)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:27.155948 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:27.220549 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1524fd1042430e97bb60caafef26f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.221318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1524fd1042430e97bb60caafef26f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.221939 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1524fd1042430e97bb60caafef26f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.229321 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1524fd1042430e97bb60caafef26f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.245487 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5532b369-8cff-4f56-9518-1efd5b65a06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1524fd1042430e97bb60caafef26f3'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.261284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1409/2813] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:28:27 2022] DELETE /identity/v3/users/bf1524fd1042430e97bb60caafef26f3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:27.474176 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:27.484622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903a8d6-f3be-4e33-a7ac-ae6ead4bd545 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:27.560195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:27.561555 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.562479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.562830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] PATH_INFO: `/v3/projects/0fa6e76580734bf5980477d32c87bfc1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.564036 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa6e76580734bf5980477d32c87bfc1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:27.566038 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:27.630515 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa6e76580734bf5980477d32c87bfc1', 'request_id': 'req-466f486a-8238-42d2-a722-4a03075811b5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.638667 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa6e76580734bf5980477d32c87bfc1', 'request_id': 'req-466f486a-8238-42d2-a722-4a03075811b5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.645338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa6e76580734bf5980477d32c87bfc1', 'request_id': 'req-466f486a-8238-42d2-a722-4a03075811b5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.656939 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] The token cache is being invalidate because project 0fa6e76580734bf5980477d32c87bfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:28:27.657264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.657924 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-466f486a-8238-42d2-a722-4a03075811b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:27.659602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1405/2814] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:28:27 2022] DELETE /identity/v3/projects/0fa6e76580734bf5980477d32c87bfc1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:27.664643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.664938 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.665473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.686182 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:27.687437 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:27.760140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1410/2815] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:28:27.769257 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.769545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.769824 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.792080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:27.793315 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:27.801699 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1406/2816] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:27.806705 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:27.820565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845cf9-4474-4349-8081-8a7bb54f7985 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:27.825588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:27.826037 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.826341 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.826614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.827493 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:28:27.827801 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:27.829669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:27.843605 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1411/2817] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 13:28:27.848273 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:27.857791 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce45b-bb7d-4ebd-ad73-7f77308cce07 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:27.862765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:27.863425 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.863704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.863978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.864683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:27.866612 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:27.881005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:27.895173 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1407/2818] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:28:27 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:28:27.899429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:27.910033 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a98cf-5b14-4bf3-a1b2-5637f5e8f892 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:27.954462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:27.969246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:27.969960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:27.970337 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:27.970728 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:27.971463 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:27.973479 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:27.994630 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1412/2819] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:28:27 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:28:27.999065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.010424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf340-eee3-4005-85f1-73cc25939168 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.015928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.016615 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.016895 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.017209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.017934 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.019578 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.036093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1408/2820] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:28.040491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.051569 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36c18-cda6-46bf-b67c-9d7a9aaebcec admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.056711 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143471-6c73-4213-80ca-745bf19c3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.057417 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143471-6c73-4213-80ca-745bf19c3e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.057733 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143471-6c73-4213-80ca-745bf19c3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.058040 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143471-6c73-4213-80ca-745bf19c3e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.058775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143471-6c73-4213-80ca-745bf19c3e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.060392 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143471-6c73-4213-80ca-745bf19c3e38 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.071140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1413/2821] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:28.075353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.086406 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fa7c-2d24-4c9c-b61d-6b5bdd93c9ae admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.093449 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.094344 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.094635 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.094911 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] PATH_INFO: `/v3/projects/75a7bc6b614b42b9bcd9a09ee785d716/users/ba5c17f329b04cfebb21deb22d10961b/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.111476 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a7bc6b614b42b9bcd9a09ee785d716, user_id=ba5c17f329b04cfebb21deb22d10961b, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.114478 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.129195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1409/2822] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:28 2022] PUT /identity/v3/projects/75a7bc6b614b42b9bcd9a09ee785d716/users/ba5c17f329b04cfebb21deb22d10961b/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:28.139760 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.140300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.140300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.169857 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] MFA Rules not processed for user `ba5c17f329b04cfebb21deb22d10961b`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:28.171378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:28.240841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1414/2823] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:28.247772 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.316629 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b06d-a82e-4cf3-869f-13bd6e239e36 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.321628 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.322235 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.322507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.322781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.323487 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.325501 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.366898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1410/2824] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:28:28 2022] POST /identity/v3/projects => generated 355 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:28.371775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.383359 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c654-b0dd-41ef-a8e4-542649e9876e None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.443050 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.443737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.444022 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.444292 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.444992 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.446971 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.478457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1415/2825] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:28:28 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:28:28.482903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.494291 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b849-155d-4c07-b457-457090439f05 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.499182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.499857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.500142 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.500421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.501219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.502828 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.514340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1411/2826] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:28.518870 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.530418 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dbe59-a27b-47b6-8c92-eafba27a7c9a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.535265 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.536167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.536449 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.536727 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] PATH_INFO: `/v3/projects/e8dc507bc8814ba1abcb2277ecdeb552/users/0a4d8d0f45034f7482ed0a7e9dfc5f5d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.554096 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dc507bc8814ba1abcb2277ecdeb552, user_id=0a4d8d0f45034f7482ed0a7e9dfc5f5d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.557048 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.572448 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1416/2827] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:28 2022] PUT /identity/v3/projects/e8dc507bc8814ba1abcb2277ecdeb552/users/0a4d8d0f45034f7482ed0a7e9dfc5f5d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:28.576587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.590462 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1305e9e-0f85-4d09-ba54-fc01d8448b4f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.660756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7529f1-d413-44b2-b8b4-9597b98d0c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.661480 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7529f1-d413-44b2-b8b4-9597b98d0c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.661765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7529f1-d413-44b2-b8b4-9597b98d0c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.662043 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7529f1-d413-44b2-b8b4-9597b98d0c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.662801 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7529f1-d413-44b2-b8b4-9597b98d0c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.664401 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7529f1-d413-44b2-b8b4-9597b98d0c80 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.674908 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1412/2828] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:28.680401 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.691318 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a602-7e2d-4926-873f-4f3bee5e54e3 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.696546 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.697506 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.697794 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.698069 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] PATH_INFO: `/v3/projects/e8dc507bc8814ba1abcb2277ecdeb552/users/0a4d8d0f45034f7482ed0a7e9dfc5f5d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.700070 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dc507bc8814ba1abcb2277ecdeb552, user_id=0a4d8d0f45034f7482ed0a7e9dfc5f5d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.702884 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.713491 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1417/2829] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:28 2022] PUT /identity/v3/projects/e8dc507bc8814ba1abcb2277ecdeb552/users/0a4d8d0f45034f7482ed0a7e9dfc5f5d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:28:28.724443 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.724736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.725044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.753203 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] MFA Rules not processed for user `0a4d8d0f45034f7482ed0a7e9dfc5f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:28.754423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:28.774217 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:28.833474 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1413/2830] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:28 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:28.845750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:28.847608 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:28.858867 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:28.945369 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7797a5-bf5c-44ff-8566-fc1559af9054 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:28.950083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:28.950745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:28.950995 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:28.951402 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:28.962469 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:28.965113 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:28.978462 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1418/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:28 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:29.055433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:29.066153 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddda30a-1024-46ee-a7b5-e4c70c74dcb7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:29.070687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed0cca-a110-4259-afdf-5054499616c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:29.071348 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0cca-a110-4259-afdf-5054499616c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:29.071619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0cca-a110-4259-afdf-5054499616c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:29.071890 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0cca-a110-4259-afdf-5054499616c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:29.133306 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed0cca-a110-4259-afdf-5054499616c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:29.134781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed0cca-a110-4259-afdf-5054499616c3 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:29.145541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1414/2832] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:38.972034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=32 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:39.141084 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=48 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:44.387473 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:44.468146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2291bf-6888-4a2e-9ac7-0cdd588576e1 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:44.473698 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:44.474665 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:44.474969 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:44.475302 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] PATH_INFO: `/v3/users/ba5c17f329b04cfebb21deb22d10961b` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:44.476528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5c17f329b04cfebb21deb22d10961b)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:44.478526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:44.538382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5c17f329b04cfebb21deb22d10961b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:44.539079 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5c17f329b04cfebb21deb22d10961b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:44.539759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5c17f329b04cfebb21deb22d10961b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:44.548110 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5c17f329b04cfebb21deb22d10961b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:44.564842 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5c17f329b04cfebb21deb22d10961b'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:44.589818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1419/2833] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:28:44 2022] DELETE /identity/v3/users/ba5c17f329b04cfebb21deb22d10961b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:44.595595 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:44.596226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:44.596226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:44.616886 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:44.618268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:44.700178 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1415/2834] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:44.714334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:44.716323 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:44.789340 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ae78-6b30-4ad0-8e1a-d9b341d3df1d admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:44.793945 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:44.794620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:44.794973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:44.795950 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:44.809001 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:44.810526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:44.822299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1420/2835] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:45.158644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:45.160126 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:45.173905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baa0a2-22fb-4ef3-acab-37edb4858169 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:45.179784 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:45.180698 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:45.181141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:45.181349 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] PATH_INFO: `/v3/projects/75a7bc6b614b42b9bcd9a09ee785d716` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:45.183052 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a7bc6b614b42b9bcd9a09ee785d716)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:45.186881 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:45.243280 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a7bc6b614b42b9bcd9a09ee785d716', 'request_id': 'req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.254354 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a7bc6b614b42b9bcd9a09ee785d716', 'request_id': 'req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.260571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a7bc6b614b42b9bcd9a09ee785d716', 'request_id': 'req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.273799 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] The token cache is being invalidate because project 75a7bc6b614b42b9bcd9a09ee785d716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:28:45.274103 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.274751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.276416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1416/2836] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:28:45 2022] DELETE /identity/v3/projects/75a7bc6b614b42b9bcd9a09ee785d716 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:45.280982 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:45.292669 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb2fb-3fe0-4d95-b8d4-1f0f900d7ec6 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:45.316528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:45.361650 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:45.362547 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:45.362827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:45.363099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] PATH_INFO: `/v3/users/0a4d8d0f45034f7482ed0a7e9dfc5f5d` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:45.364367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4d8d0f45034f7482ed0a7e9dfc5f5d)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:45.366382 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:45.419409 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4d8d0f45034f7482ed0a7e9dfc5f5d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.420293 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4d8d0f45034f7482ed0a7e9dfc5f5d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.420790 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4d8d0f45034f7482ed0a7e9dfc5f5d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.431395 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4d8d0f45034f7482ed0a7e9dfc5f5d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.444209 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-0e146ea2-155e-4e82-ac8e-87e5993b7276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4d8d0f45034f7482ed0a7e9dfc5f5d'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:45.463936 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1421/2837] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:28:45 2022] DELETE /identity/v3/users/0a4d8d0f45034f7482ed0a7e9dfc5f5d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:45.839899 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:45.843451 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:45.863596 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3a7f-e9a2-4de6-ac53-e4bbf2efb5bb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:45.947866 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:45.948769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:45.949074 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:45.949363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] PATH_INFO: `/v3/projects/e8dc507bc8814ba1abcb2277ecdeb552` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:45.950594 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dc507bc8814ba1abcb2277ecdeb552)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:45.953283 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:45.991145 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:46.012755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dc507bc8814ba1abcb2277ecdeb552', 'request_id': 'req-de2f9559-304c-4b0f-b018-48e3fe0c8053'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:46.021781 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dc507bc8814ba1abcb2277ecdeb552', 'request_id': 'req-de2f9559-304c-4b0f-b018-48e3fe0c8053'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:46.030170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dc507bc8814ba1abcb2277ecdeb552', 'request_id': 'req-de2f9559-304c-4b0f-b018-48e3fe0c8053'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:46.042026 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] The token cache is being invalidate because project e8dc507bc8814ba1abcb2277ecdeb552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:28:46.042301 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:46.043003 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-de2f9559-304c-4b0f-b018-48e3fe0c8053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:46.044601 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1417/2838] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:28:45 2022] DELETE /identity/v3/projects/e8dc507bc8814ba1abcb2277ecdeb552 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:46.050114 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.050398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.050681 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.069580 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:46.070799 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:46.138098 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1422/2839] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:46.146729 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.147031 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.147330 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.169220 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:46.170820 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:46.181903 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1418/2840] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:46.188327 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.200431 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189933-c0c2-4f37-87bb-0c2fd3bde111 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.205832 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.206581 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.206920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.207264 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.208053 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:28:46.208366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.210164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.226759 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1423/2841] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:28:46.231532 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.243656 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bead3d-5932-448a-b26c-70aebcf61380 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.251450 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.252804 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.253208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.253607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.254756 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.257363 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.296065 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1419/2842] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:46.302513 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.320255 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc0b8-898e-45c1-8f4c-2b5be0d3b0e0 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.350043 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:46.392529 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.393140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.393443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.393718 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.394507 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.396460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.419159 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1424/2843] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:46.425966 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.441149 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e5d8-996f-4eae-91f2-14c4ab3de549 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.447299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.448091 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.448525 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.448920 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.449602 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.451446 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.463775 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1420/2844] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:46.468320 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.480220 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580c0a2-2283-4fd2-8594-d07135f849f9 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.486601 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2778-6c47-4511-8a62-49934112e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.487285 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2778-6c47-4511-8a62-49934112e7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.487561 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2778-6c47-4511-8a62-49934112e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.487830 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2778-6c47-4511-8a62-49934112e7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.488576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2778-6c47-4511-8a62-49934112e7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.490300 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2778-6c47-4511-8a62-49934112e7d6 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.508099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1425/2845] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:46.512548 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.526373 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd42b1-1504-4b9b-ad7a-83c6caf40c20 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.532570 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.533512 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.533794 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.534070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] PATH_INFO: `/v3/projects/9235ae05190045dbb2ce1e2fcff35eeb/users/e29ebdfbb0044a59af3725e26bcc40ed/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.550141 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9235ae05190045dbb2ce1e2fcff35eeb, user_id=e29ebdfbb0044a59af3725e26bcc40ed, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.552913 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.569622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1421/2846] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:46 2022] PUT /identity/v3/projects/9235ae05190045dbb2ce1e2fcff35eeb/users/e29ebdfbb0044a59af3725e26bcc40ed/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:46.580435 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.581277 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.581610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.613066 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] MFA Rules not processed for user `e29ebdfbb0044a59af3725e26bcc40ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:46.614334 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:46.688704 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1426/2847] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:46.693776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.767764 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535840-4c53-4fc0-b36f-3070480c266f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.772776 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.773521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.773808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.774080 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.774793 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.776687 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.809502 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1422/2848] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:46.813527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.825276 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd15c-3265-4a1e-818a-6ab6297627e8 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.897644 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.898515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.898808 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.899130 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.899841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.901840 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.924175 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1427/2849] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:28:46 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:46.928787 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.940424 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616c12-5d3a-46ec-8b5e-be50d46b6b90 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.946507 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.947196 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.947500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.947755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:46.948765 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:46.950428 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:46.962572 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1423/2850] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:46.967838 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:46.979658 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39499-9f6d-4527-bd82-89362a1c26d7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:46.987058 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:46.987966 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:46.988247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:46.988526 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] PATH_INFO: `/v3/projects/ab19fffd2ee147e6a70ba6e64011fb7f/users/59a1b6cfd7904d59b3aaf94a2c8840ac/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:47.005064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab19fffd2ee147e6a70ba6e64011fb7f, user_id=59a1b6cfd7904d59b3aaf94a2c8840ac, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:47.007751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:47.022709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1428/2851] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:46 2022] PUT /identity/v3/projects/ab19fffd2ee147e6a70ba6e64011fb7f/users/59a1b6cfd7904d59b3aaf94a2c8840ac/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:47.027268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:47.045606 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c260d5-5064-461f-b6f0-a6929a78b69c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:47.076521 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:47.127294 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542900-21cd-4ed1-990e-1edf57bcecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:47.127981 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542900-21cd-4ed1-990e-1edf57bcecbf admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:47.128264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542900-21cd-4ed1-990e-1edf57bcecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:47.128541 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542900-21cd-4ed1-990e-1edf57bcecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:47.129565 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542900-21cd-4ed1-990e-1edf57bcecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:47.130952 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542900-21cd-4ed1-990e-1edf57bcecbf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:47.141704 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1424/2852] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:47.150432 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:47.162217 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:47.168930 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555f28-0293-4e8c-8d14-839152a32b38 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:47.174837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:47.175774 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:47.176054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:47.176328 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] PATH_INFO: `/v3/projects/ab19fffd2ee147e6a70ba6e64011fb7f/users/59a1b6cfd7904d59b3aaf94a2c8840ac/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:47.178489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab19fffd2ee147e6a70ba6e64011fb7f, user_id=59a1b6cfd7904d59b3aaf94a2c8840ac, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:47.181336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:47.193254 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1429/2853] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:47 2022] PUT /identity/v3/projects/ab19fffd2ee147e6a70ba6e64011fb7f/users/59a1b6cfd7904d59b3aaf94a2c8840ac/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:47.263818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:47.264155 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:47.264376 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:47.295989 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] MFA Rules not processed for user `59a1b6cfd7904d59b3aaf94a2c8840ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:47.298055 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:47.379875 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1425/2854] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:47.388903 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:47.390848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:47.477457 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567ef5-b774-4a72-91c8-26619440130e admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:47.484013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:47.485190 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:47.485614 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:47.485738 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:47.498472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:47.500261 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:47.511398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1430/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:47.597715 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:47.608359 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cf00d-7ee2-4ad0-9259-b7ed6df6f839 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:47.612489 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880914-b6d3-43ff-b6ef-4657be7788cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:47.613177 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880914-b6d3-43ff-b6ef-4657be7788cf service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:47.613460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880914-b6d3-43ff-b6ef-4657be7788cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:47.613736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880914-b6d3-43ff-b6ef-4657be7788cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:47.684763 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880914-b6d3-43ff-b6ef-4657be7788cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:47.686339 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880914-b6d3-43ff-b6ef-4657be7788cf service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:47.696668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1426/2856] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:48.002756 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:48.074896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ef3b-9797-4c0c-b266-20b7b46d1235 service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:48.080229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:48.081169 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:48.081482 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:48.081722 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] PATH_INFO: `/v3/users/e29ebdfbb0044a59af3725e26bcc40ed` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:48.083089 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29ebdfbb0044a59af3725e26bcc40ed)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:48.085046 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:48.148077 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29ebdfbb0044a59af3725e26bcc40ed'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.149166 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29ebdfbb0044a59af3725e26bcc40ed'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.149896 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29ebdfbb0044a59af3725e26bcc40ed'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.158592 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29ebdfbb0044a59af3725e26bcc40ed'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.172238 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29ebdfbb0044a59af3725e26bcc40ed'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.187818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1431/2857] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:28:48 2022] DELETE /identity/v3/users/e29ebdfbb0044a59af3725e26bcc40ed => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:48.193099 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:48.193868 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:48.194071 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:48.215311 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:48.216766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:48.269998 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:48.293814 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1427/2858] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:48.305973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:48.307558 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:48.323073 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:48.389901 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e080-1e47-4719-9229-4b5378c9314c admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:48.393929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:48.394792 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:48.394942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:48.395167 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:48.410059 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:48.411536 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:48.422984 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1432/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:48.746878 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:48.748947 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:48.767889 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a840f0-68fc-47a1-92fb-92dd854943c7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:48.773668 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:48.774683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:48.774971 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:48.775254 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] PATH_INFO: `/v3/projects/9235ae05190045dbb2ce1e2fcff35eeb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:48.776808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9235ae05190045dbb2ce1e2fcff35eeb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:48.779298 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:48.840632 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9235ae05190045dbb2ce1e2fcff35eeb', 'request_id': 'req-4eb37681-3877-4d2a-9297-148ec331b596'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.850416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9235ae05190045dbb2ce1e2fcff35eeb', 'request_id': 'req-4eb37681-3877-4d2a-9297-148ec331b596'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.858414 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9235ae05190045dbb2ce1e2fcff35eeb', 'request_id': 'req-4eb37681-3877-4d2a-9297-148ec331b596'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.873297 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] The token cache is being invalidate because project 9235ae05190045dbb2ce1e2fcff35eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:28:48.873610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.874340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:48.876208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1428/2860] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:28:48 2022] DELETE /identity/v3/projects/9235ae05190045dbb2ce1e2fcff35eeb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:48.880607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:48.891126 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66917b5-51c1-4b0b-8574-6f432a7d5c5f service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:48.957551 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:48.958553 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:48.958803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:48.959144 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] PATH_INFO: `/v3/users/59a1b6cfd7904d59b3aaf94a2c8840ac` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:48.960515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a1b6cfd7904d59b3aaf94a2c8840ac)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:48.962534 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:49.023565 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a1b6cfd7904d59b3aaf94a2c8840ac'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.024248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a1b6cfd7904d59b3aaf94a2c8840ac'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.024898 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a1b6cfd7904d59b3aaf94a2c8840ac'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.033188 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a1b6cfd7904d59b3aaf94a2c8840ac'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.050004 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-e5d22a9f-f361-4e8d-9512-13f722555939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a1b6cfd7904d59b3aaf94a2c8840ac'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.067109 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1433/2861] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:28:48 2022] DELETE /identity/v3/users/59a1b6cfd7904d59b3aaf94a2c8840ac => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:49.401482 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:49.403191 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:49.418485 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb37681-3877-4d2a-9297-148ec331b596 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:49.490081 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:49.490970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.491293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.491550 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] PATH_INFO: `/v3/projects/ab19fffd2ee147e6a70ba6e64011fb7f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.492815 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab19fffd2ee147e6a70ba6e64011fb7f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:49.494790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:49.552766 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab19fffd2ee147e6a70ba6e64011fb7f', 'request_id': 'req-96d0efed-582d-4f01-8158-3fca0389555b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.562610 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab19fffd2ee147e6a70ba6e64011fb7f', 'request_id': 'req-96d0efed-582d-4f01-8158-3fca0389555b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.570420 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab19fffd2ee147e6a70ba6e64011fb7f', 'request_id': 'req-96d0efed-582d-4f01-8158-3fca0389555b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.579803 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:49.589384 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] The token cache is being invalidate because project ab19fffd2ee147e6a70ba6e64011fb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:28:49.589869 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.590905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96d0efed-582d-4f01-8158-3fca0389555b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:28:49.593738 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1429/2862] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:28:49 2022] DELETE /identity/v3/projects/ab19fffd2ee147e6a70ba6e64011fb7f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:49.600573 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.600973 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.601298 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.625068 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:49.626343 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:49.663933 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:49.706021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1434/2863] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:49.718843 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.719131 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.719441 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.745773 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:49.747070 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:49.756101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1430/2864] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:49.760583 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:49.771013 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ddbf2-5741-4275-9ed0-9b17abf0208c None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:49.775731 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:49.776412 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.776693 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.777172 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.777920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:28:49.778229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:49.779873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:49.794039 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1435/2865] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:28:49.800195 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:49.810299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa5c4d-2b24-4a97-8218-1112093472d0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:49.816874 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:49.817914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.818335 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.818741 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.819847 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:49.822829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:49.852263 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1431/2866] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:28:49 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:49.856621 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:49.870871 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e567ac-2971-434e-86bd-fe943babe57a admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:49.939848 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:49.940657 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.940894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.941228 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.941929 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:49.944086 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:49.966890 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1436/2867] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:28:49 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:49.972465 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:49.985935 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b5a7e-c029-4308-a0cd-c5ed8529549b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:49.991931 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:49.992622 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:49.992906 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:49.993210 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:49.993961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:49.995571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:50.007786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1432/2868] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 13:28:50.012460 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:50.023379 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d194d05-d6aa-480b-8b25-5d0c81455269 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:50.028620 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8caa35-25a5-4042-ac60-2d2da0b76dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:50.029483 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8caa35-25a5-4042-ac60-2d2da0b76dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:50.029777 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8caa35-25a5-4042-ac60-2d2da0b76dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:50.030072 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8caa35-25a5-4042-ac60-2d2da0b76dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:50.030751 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8caa35-25a5-4042-ac60-2d2da0b76dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:50.032667 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8caa35-25a5-4042-ac60-2d2da0b76dc5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:50.043588 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1437/2869] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:50.048556 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:50.064058 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b0f6f-adaa-4967-abb6-03cf6dbfaf9b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:50.069785 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:50.070701 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:50.070977 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:50.071252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] PATH_INFO: `/v3/projects/79538d9d1cab418599c06ae95cc2bbe9/users/415583aa0e054b70809b88c43bb485b5/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:50.091421 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79538d9d1cab418599c06ae95cc2bbe9, user_id=415583aa0e054b70809b88c43bb485b5, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:50.094252 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:50.113461 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1433/2870] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:50 2022] PUT /identity/v3/projects/79538d9d1cab418599c06ae95cc2bbe9/users/415583aa0e054b70809b88c43bb485b5/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:50.119737 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3823-1788-43d9-b762-7daeef4b1bbc None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:50.120062 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3823-1788-43d9-b762-7daeef4b1bbc None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:50.120370 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3823-1788-43d9-b762-7daeef4b1bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:50.139974 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6fab3823-1788-43d9-b762-7daeef4b1bbc None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:50.141246 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6fab3823-1788-43d9-b762-7daeef4b1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:50.209260 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1438/2871] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:50.220264 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:50.222075 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:50.287182 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25e694-2882-42b0-8cc1-9ddea562d2b3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:50.290915 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:50.291576 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:50.291860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:50.292136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:50.302028 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:50.303468 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:50.313829 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1434/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:51.009099 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.009818 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.010129 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.182819 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] MFA Rules not processed for user `415583aa0e054b70809b88c43bb485b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:51.183968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:51.221076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:51.264941 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1439/2873] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:51.269892 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:51.280229 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2f54-4e54-4fc3-b58a-9bc536a0bbd8 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:51.285304 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:51.285978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.286261 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.286537 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.287268 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:51.289237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:51.319958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1435/2874] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:51.324270 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:51.336708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58434c8c-9ba7-4d80-9ab4-da74fc157474 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:51.402709 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:51.403429 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.403741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.404021 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.404775 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:51.406825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:51.429918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1440/2875] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:28:51 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:28:51.434208 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:51.445936 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2e9a7-f5c3-4b29-9183-31753100bc66 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:51.452407 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:51.453970 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.454338 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.454619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.455442 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:51.457100 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:51.470956 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1436/2876] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:51.476356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:51.487928 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657019ca-8f53-40d1-bb05-0613f435d4b5 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:51.493336 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:51.494367 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.494646 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.494918 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] PATH_INFO: `/v3/projects/b8ebdce67dbb453f8d6c656fe6aeb4ca/users/b2a211073bee4ca0babc7a577e013b2d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.511413 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ebdce67dbb453f8d6c656fe6aeb4ca, user_id=b2a211073bee4ca0babc7a577e013b2d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:51.514164 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:51.530823 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1441/2877] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:51 2022] PUT /identity/v3/projects/b8ebdce67dbb453f8d6c656fe6aeb4ca/users/b2a211073bee4ca0babc7a577e013b2d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:51.535012 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:51.546186 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac5cb-5b2d-40ce-9307-f5f5b1e91c27 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:51.623025 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13a42d-1c52-46dd-801e-837fa82c186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:51.623808 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13a42d-1c52-46dd-801e-837fa82c186e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.624093 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13a42d-1c52-46dd-801e-837fa82c186e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.624369 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13a42d-1c52-46dd-801e-837fa82c186e admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.625170 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13a42d-1c52-46dd-801e-837fa82c186e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:51.626788 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13a42d-1c52-46dd-801e-837fa82c186e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:51.632860 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:51.642816 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1437/2878] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:28:51.646997 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:51.661378 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab515ff-d1d9-47e8-b6a3-bd7f869ff420 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:51.666570 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:51.667465 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:51.667745 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:51.668024 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] PATH_INFO: `/v3/projects/b8ebdce67dbb453f8d6c656fe6aeb4ca/users/b2a211073bee4ca0babc7a577e013b2d/roles/62f04dcd631e4206baea551a55948cbb` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:51.670142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ebdce67dbb453f8d6c656fe6aeb4ca, user_id=b2a211073bee4ca0babc7a577e013b2d, role_id=62f04dcd631e4206baea551a55948cbb)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:51.673563 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:51.684764 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1442/2879] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:28:51 2022] PUT /identity/v3/projects/b8ebdce67dbb453f8d6c656fe6aeb4ca/users/b2a211073bee4ca0babc7a577e013b2d/roles/62f04dcd631e4206baea551a55948cbb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:28:52.464832 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:52.465551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:52.465551 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:52.500165 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] MFA Rules not processed for user `b2a211073bee4ca0babc7a577e013b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:28:52.501433 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:52.605321 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1438/2880] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:28:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:28:52.620084 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:52.622044 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:52.692593 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c89b7-fb9a-4cf6-aecb-c5c04a7f32b7 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:52.696585 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:52.697299 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:52.697575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:52.697850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:52.740545 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:52.771107 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:52.772560 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:52.782643 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1443/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:28:54.171129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:28:54.172695 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:28:54.185455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24111e-4500-4bcb-98de-1c1a9c7a7237 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:28:54.189898 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:28:54.190937 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:28:54.191226 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:28:54.191577 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:28:54.201607 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:28:54.203106 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:28:54.214398 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1439/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:28:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:29:00.331590 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:00.335607 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:00.462850 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769422-dc9d-4e66-9e70-34517c164c4a service cinder] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:00.469509 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfe0c829ddb45cbb59b275e4c8349f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:00.470542 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:00.471151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:00.471778 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:00.475869 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:00.501484 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:00.504140 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:00.520064 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1444/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:29:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:29:04.209861 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=40 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:08.169693 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:08.171779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:08.249189 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:08.316557 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290253-5ca7-410d-a295-419df0e3eec5 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:08.325535 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:08.326694 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:08.327152 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:08.327434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:08.330589 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:08.347053 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:08.348978 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:08.366224 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1440/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:29:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:29:08.373394 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8dfc-2d75-4a1d-ab21-dbdcf9e043f8 service nova] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:08.382615 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:08.384263 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:08.384779 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:08.385346 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] PATH_INFO: `/v3/users/415583aa0e054b70809b88c43bb485b5` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:08.387184 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415583aa0e054b70809b88c43bb485b5)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:08.389623 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:08.458528 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415583aa0e054b70809b88c43bb485b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.459214 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415583aa0e054b70809b88c43bb485b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.459828 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415583aa0e054b70809b88c43bb485b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.467989 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415583aa0e054b70809b88c43bb485b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.475411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:08.487682 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-c9bc380a-20e5-4153-b0f1-1838daf76864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415583aa0e054b70809b88c43bb485b5'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.505229 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1445/2885] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:29:08 2022] DELETE /identity/v3/users/415583aa0e054b70809b88c43bb485b5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 13:29:08.697686 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:08.719423 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afd6c9-3808-4911-b192-c04fdd5ed2dc service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:08.794769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:08.795644 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:08.795914 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:08.796222 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] PATH_INFO: `/v3/projects/79538d9d1cab418599c06ae95cc2bbe9` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:08.797680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79538d9d1cab418599c06ae95cc2bbe9)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:08.799460 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:08.804398 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:08.804687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:08.804960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:08.860114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79538d9d1cab418599c06ae95cc2bbe9', 'request_id': 'req-ac21475d-b10a-4f95-843d-1352a9b414a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.860455 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] MFA Rules not processed for user `fe9bf3adc64846df903b1646b4fe1a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:29:08.861715 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:08.869127 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79538d9d1cab418599c06ae95cc2bbe9', 'request_id': 'req-ac21475d-b10a-4f95-843d-1352a9b414a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.875265 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79538d9d1cab418599c06ae95cc2bbe9', 'request_id': 'req-ac21475d-b10a-4f95-843d-1352a9b414a7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.887796 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] The token cache is being invalidate because project 79538d9d1cab418599c06ae95cc2bbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:29:08.888136 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.888841 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:08.890917 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1441/2886] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:29:08 2022] DELETE /identity/v3/projects/79538d9d1cab418599c06ae95cc2bbe9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:08.895599 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:08.897244 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:08.922256 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:08.933091 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1446/2887] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jun 7 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:29:08.971430 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21475d-b10a-4f95-843d-1352a9b414a7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:08.977526 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:08.978536 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:08.978912 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:08.979010 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] PATH_INFO: `/v3/users/b2a211073bee4ca0babc7a577e013b2d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:08.980367 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a211073bee4ca0babc7a577e013b2d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:08.982333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:08.987636 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:08.989494 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:09.036528 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a211073bee4ca0babc7a577e013b2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.037277 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a211073bee4ca0babc7a577e013b2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.037961 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a211073bee4ca0babc7a577e013b2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.045675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a211073bee4ca0babc7a577e013b2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.058296 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a211073bee4ca0babc7a577e013b2d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.072747 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1442/2888] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:29:08 2022] DELETE /identity/v3/users/b2a211073bee4ca0babc7a577e013b2d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:09.094505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570f81e-cd1e-41be-9db6-4a252c0ef954 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.131404 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:09.172741 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a96be7cce14b2e964bb6f3ff2d9b7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.173357 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.173649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.173926 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.176284 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:09.247610 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.249247 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0674-6307-4db4-ab7f-6956d5201d94 service swift] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.259034 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1447/2889] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jun 7 13:29:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:09.283412 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.286683 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:09.366845 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2667d2-eedf-47aa-872b-049b8a70fe5a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.375419 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.376646 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.376928 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.377237 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] PATH_INFO: `/v3/projects/b8ebdce67dbb453f8d6c656fe6aeb4ca` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.378705 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ebdce67dbb453f8d6c656fe6aeb4ca)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.380680 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.435830 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:09.448416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ebdce67dbb453f8d6c656fe6aeb4ca', 'request_id': 'req-421c6149-f3da-4165-be4e-d25a71cdf616'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.459885 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ebdce67dbb453f8d6c656fe6aeb4ca', 'request_id': 'req-421c6149-f3da-4165-be4e-d25a71cdf616'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.470790 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ebdce67dbb453f8d6c656fe6aeb4ca', 'request_id': 'req-421c6149-f3da-4165-be4e-d25a71cdf616'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.489299 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] The token cache is being invalidate because project b8ebdce67dbb453f8d6c656fe6aeb4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:29:09.489587 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.490293 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-421c6149-f3da-4165-be4e-d25a71cdf616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:09.491983 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1443/2890] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:29:09 2022] DELETE /identity/v3/projects/b8ebdce67dbb453f8d6c656fe6aeb4ca => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:09.498146 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.498434 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.498714 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.519750 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:29:09.520985 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:09.599313 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1448/2891] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:29:09.608044 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.608326 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.608592 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.629716 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:29:09.631001 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:09.640503 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1444/2892] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 13:29:09.645376 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.657923 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5979-c032-414c-86e8-df35e4d990d7 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.664837 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.665572 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.665852 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.666124 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] PATH_INFO: `/v3/domains` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.666873 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 13:29:09.667203 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.668816 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.682576 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1449/2893] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jun 7 13:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 13:29:09.687035 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.701340 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ec08-a16a-4755-8798-c28e680abe2e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.708166 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.708857 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.709172 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.709447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.710238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.712101 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.765958 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1445/2894] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jun 7 13:29:09 2022] POST /identity/v3/projects => generated 359 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 13:29:09.770787 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.786716 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cae67e-7788-4d2a-afb1-8e76b5b9869b admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.862515 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.863248 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.863530 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.863827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] PATH_INFO: `/v3/users` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.864538 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.866523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.877095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:09.893240 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1450/2895] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jun 7 13:29:09 2022] POST /identity/v3/users => generated 280 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 13:29:09.895523 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.907751 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad728ce-c3e6-4b67-ab1c-46f82ba85d38 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.913675 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.914387 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.914670 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.914955 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.915736 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.917434 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.929999 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1446/2896] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:29:09.935322 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.948187 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90341-ca89-4586-ba01-eaa4b415bcef admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.953443 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afacfc-45a5-4d53-8c52-bf99b8051d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.954216 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afacfc-45a5-4d53-8c52-bf99b8051d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.954568 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afacfc-45a5-4d53-8c52-bf99b8051d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.954915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afacfc-45a5-4d53-8c52-bf99b8051d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:09.955685 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afacfc-45a5-4d53-8c52-bf99b8051d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:09.957589 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afacfc-45a5-4d53-8c52-bf99b8051d2d admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:09.972981 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1451/2897] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jun 7 13:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 13:29:09.977665 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:09.990132 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734239be-11a2-47fd-9c9d-b5352ae1f6c4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:09.996707 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:09.997350 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:09.997703 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:09.998621 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] PATH_INFO: `/v3/projects/ed88017cbbaf458f971ca2aff73c824c/users/fc15882c56114943a9e8398ba44ab90e/roles/c5faf990280443b18b96e64a7fee2798` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:10.015848 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed88017cbbaf458f971ca2aff73c824c, user_id=fc15882c56114943a9e8398ba44ab90e, role_id=c5faf990280443b18b96e64a7fee2798)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:10.018660 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:10.037447 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1447/2898] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jun 7 13:29:09 2022] PUT /identity/v3/projects/ed88017cbbaf458f971ca2aff73c824c/users/fc15882c56114943a9e8398ba44ab90e/roles/c5faf990280443b18b96e64a7fee2798 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:10.049505 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] REQUEST_METHOD: `POST` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:10.050076 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:10.050574 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:10.081725 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.auth.core [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] MFA Rules not processed for user `fc15882c56114943a9e8398ba44ab90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:29:10.082960 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:10.166812 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1452/2899] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:29:10.200448 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:10.202288 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:10.270396 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17b74-cc2e-49de-ba72-5b6f0bbfcb38 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:10.274514 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0cd35-0820-4b4d-9431-a3833c0b7048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82194f91a6fb4600988755c126818b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:10.275399 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0cd35-0820-4b4d-9431-a3833c0b7048 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:10.275571 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0cd35-0820-4b4d-9431-a3833c0b7048 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:10.275769 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0cd35-0820-4b4d-9431-a3833c0b7048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:10.293508 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0cd35-0820-4b4d-9431-a3833c0b7048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:10.295880 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0cd35-0820-4b4d-9431-a3833c0b7048 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:10.309859 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1448/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:29:10 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:29:10.325181 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:10.393785 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5ff1-8887-48c3-a057-2b360877d950 None None] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:10.399416 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:10.400433 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:10.400700 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:10.400849 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] PATH_INFO: `/v3/users/fc15882c56114943a9e8398ba44ab90e` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:10.402233 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc15882c56114943a9e8398ba44ab90e)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:10.404275 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:10.474198 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc15882c56114943a9e8398ba44ab90e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:10.474886 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc15882c56114943a9e8398ba44ab90e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:10.475496 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc15882c56114943a9e8398ba44ab90e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:10.485438 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc15882c56114943a9e8398ba44ab90e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:10.500877 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc15882c56114943a9e8398ba44ab90e'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:10.502827 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:10.523527 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1453/2901] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:29:10 2022] DELETE /identity/v3/users/fc15882c56114943a9e8398ba44ab90e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:10.529416 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:10.529782 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:10.530161 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:10.549333 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] MFA Rules not processed for user `f8993b31c1f849d2899564c3495501c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 13:29:10.550925 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:10.630129 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:10.644479 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1449/2902] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jun 7 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 13:29:10.674478 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:10.676366 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:10.786729 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3957ab-4b50-4940-959e-bbeed38aeb78 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:10.792458 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36b7fcbf1a134a5a874da581578981d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:10.793415 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:10.793841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:10.794250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:10.808151 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:10.810408 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:10.825097 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1454/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:29:11.282566 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:11.284778 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:11.310073 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff755-d5be-446a-9796-57a0773bd45b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:11.318051 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:11.319005 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:11.319219 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:11.319491 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] PATH_INFO: `/v3/projects/ed88017cbbaf458f971ca2aff73c824c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:11.321238 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed88017cbbaf458f971ca2aff73c824c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:11.323619 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:11.380455 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed88017cbbaf458f971ca2aff73c824c', 'request_id': 'req-efcd217f-db22-47cd-9433-4f62ca5e20c8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:11.390921 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed88017cbbaf458f971ca2aff73c824c', 'request_id': 'req-efcd217f-db22-47cd-9433-4f62ca5e20c8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:11.398818 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed88017cbbaf458f971ca2aff73c824c', 'request_id': 'req-efcd217f-db22-47cd-9433-4f62ca5e20c8'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:11.411758 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] The token cache is being invalidate because project ed88017cbbaf458f971ca2aff73c824c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:29:11.412088 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:11.412755 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:11.414672 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1450/2904] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:29:11 2022] DELETE /identity/v3/projects/ed88017cbbaf458f971ca2aff73c824c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:16.701617 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:16.703411 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:16.719083 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac88e-9bdc-4965-ad60-04fb66643360 service neutron] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:16.778342 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:16.779244 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:16.779523 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:16.779800 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] PATH_INFO: `/v3/users/0ff2575eecdc4e668844f62411861db9` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:16.781095 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff2575eecdc4e668844f62411861db9)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:16.783054 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:16.832942 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff2575eecdc4e668844f62411861db9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:16.833652 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff2575eecdc4e668844f62411861db9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:16.834250 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff2575eecdc4e668844f62411861db9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:16.841603 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff2575eecdc4e668844f62411861db9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:16.854649 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff2575eecdc4e668844f62411861db9'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:16.869606 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1455/2905] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:29:16 2022] DELETE /identity/v3/users/0ff2575eecdc4e668844f62411861db9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:17.068049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:17.069604 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:17.083069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd217f-db22-47cd-9433-4f62ca5e20c8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:17.161307 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:17.162211 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:17.162500 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:17.162844 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] PATH_INFO: `/v3/projects/e94ac089c7dd468b8f0ca7f8fa14769e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:17.164069 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94ac089c7dd468b8f0ca7f8fa14769e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:17.166078 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:17.215116 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'request_id': 'req-09e9e6e5-cea7-48a4-980d-61278743c879'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.227789 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'request_id': 'req-09e9e6e5-cea7-48a4-980d-61278743c879'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.234545 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'request_id': 'req-09e9e6e5-cea7-48a4-980d-61278743c879'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.247137 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] The token cache is being invalidate because project e94ac089c7dd468b8f0ca7f8fa14769e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:29:17.247426 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.248123 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.249779 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1451/2906] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:29:17 2022] DELETE /identity/v3/projects/e94ac089c7dd468b8f0ca7f8fa14769e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:17.253968 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:17.255451 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:17.268307 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad31c77-538a-4ecf-96a1-883c82359d56 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:17.277522 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:17.333915 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:17.334803 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:17.335081 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:17.335356 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] PATH_INFO: `/v3/users/99227c5dc50040bfbcb4f505f3f02659` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:17.336571 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99227c5dc50040bfbcb4f505f3f02659)` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:17.338533 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:17.401485 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99227c5dc50040bfbcb4f505f3f02659'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.402160 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99227c5dc50040bfbcb4f505f3f02659'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.402825 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99227c5dc50040bfbcb4f505f3f02659'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.411708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99227c5dc50040bfbcb4f505f3f02659'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.427920 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.notifications [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99227c5dc50040bfbcb4f505f3f02659'} {{(pid=80514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.445726 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1456/2907] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jun 7 13:29:17 2022] DELETE /identity/v3/users/99227c5dc50040bfbcb4f505f3f02659 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:17.653709 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:17.655209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:17.670030 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e6e5-cea7-48a4-980d-61278743c879 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:17.683138 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:17.742353 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8993b31c1f849d2899564c3495501c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd193fab79b438b93f957ec4ee6cab4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:17.743499 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:17.743786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:17.743786 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] PATH_INFO: `/v3/projects/e9a55f5d9b3d4c61ba0100968066d0b7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:17.745114 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a55f5d9b3d4c61ba0100968066d0b7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:17.747049 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:17.799394 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a55f5d9b3d4c61ba0100968066d0b7', 'request_id': 'req-f73db86f-4d16-43f1-a359-ebe23dac61b4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.807095 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a55f5d9b3d4c61ba0100968066d0b7', 'request_id': 'req-f73db86f-4d16-43f1-a359-ebe23dac61b4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.812842 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a55f5d9b3d4c61ba0100968066d0b7', 'request_id': 'req-f73db86f-4d16-43f1-a359-ebe23dac61b4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.825209 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] The token cache is being invalidate because project e9a55f5d9b3d4c61ba0100968066d0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 13:29:17.825504 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.826255 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f73db86f-4d16-43f1-a359-ebe23dac61b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 13:29:17.828383 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1452/2908] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jun 7 13:29:17 2022] DELETE /identity/v3/projects/e9a55f5d9b3d4c61ba0100968066d0b7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 13:29:27.441894 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=47,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:27.821905 dv-cinder-844962-1-iscsi devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:59.668015 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Authenticating user token {{(pid=80514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 13:29:59.669841 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:59.740991 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c156c-49d5-4426-a8bb-4e5d41e49896 admin admin] Validating token access rules against request {{(pid=80514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 13:29:59.805472 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd775aea1464a40e2887ed69c25a34f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbca9d5cfed849a2b4112de05e2fa2bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 13:29:59.806142 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] REQUEST_METHOD: `GET` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 13:29:59.806425 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] SCRIPT_NAME: `/identity` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 13:29:59.806701 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 13:29:59.808708 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.fernet_utils [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 13:29:59.820687 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 13:29:59.822353 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fbed-8c90-4db8-9f19-d8675a9e5d97 service placement] RBAC: Authorization granted {{(pid=80514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 13:29:59.832575 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: [pid: 80514|app: 0|req: 1457/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jun 7 13:29:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 13:30:09.828489 dv-cinder-844962-1-iscsi devstack@keystone.service[80514]: DEBUG dbcounter [-] [80514] Writing DB stats keystone:SELECT=58 {{(pid=80514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}